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ABSTRACT 

The needs of students in the public schools of 
Colorado are reviewed in a report that contains two types of 
information: (1) descriptions of some educational outcomes commonly 
desired in Colorado, as found in statements of goals and objectives; 
and (2) descriptions of student performance on the assessment 
inventory given in the spring of 1971. Results of pupil performance 
on assessment exercises are given for language skills, learner 
self-concept, social knowledge and skills, health information, and 
music appreciation. There are instances throughout where students 
have acquired certain skills, knowledge, and attitudes, and some 
instances where they have not. The statewide findings should be 
interpreted by local district personnel in terms of specific 
objectives for their school programs. (LH) 
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FOREWORD 



This report has been prepared in accordance with the 
Elementary and Secondary Act of 1965 » Title III, guidelines 
and Is addressed to all who wish to know and understand the 
needs of students in the public schools of Colorado. It con- 
tains information of two types: 

1. Descriptions of some educational outcomes 
commonly desired in Colorado, as found in 
statements of goals and objectives; 

2. Descriptions of student performance on the 
assessment inventory given in the Spring of 
1971. 

Throughout this report, the reader will find some 
instances where students have acquired certain skills, knowl- 
edge, and attitudes and some instances where they have not. 
These statewide findings should be interpreted by local district 
personnel in terms of specific objectives for their school 
programs. Each local district can decide for itself the appro- 
priateness of the needs identified in the report and the degree 
to which their existing programs should be modified. 



Donald D. Wooding ton 
Commissioner of Education 
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I. INTRODUCTION 



Consistent with guidelines promulgated by the Elementary and Secon- 
dary Education Act of 1965 (Title III), this Assessment: 

1. Identified some outcomes commonly desired from Colorado 
schools. 

2. Determined the extent to which students in Colorado have 
obtained certain of these outcomes. 

3. Reported the findings and offered conclusions regarding 
learner achievements and needs in Colorado. 

The nature of the Assessment and organization of this report are des- 
cribed briefly below. (Details are in the Appendix.) 5 

Nature of the Assessment 

The Assessment sought answers to the question, "Have students in Colo- 
rado acquired capabilities which will enable them to enjoy the benefits 
described by Educational Goals for Colorado Citizens* ? 11 . Assessment pro- 
cesses included: (I) restating the Goals into performance objectives, 

(2) creating objectives -referenced exercises, (3) sampling, and (4) analy- 
zing student responses. 

Restating the goals . In 1969, a Task Force on Assessment and Evalu- 
ation first analyzed Goals for Education in Colorado* * into specific, year- 
end objectives which described student performance capabilities in several 
curricular areas, and then submitted these objectives for professional 
j udgement . 

Creating exercises . Consultants retained by the Colorado Department of 
Education created exercises by which students could demonstrate capabilities 
specified in the common ly-desi red performance objectives. Staff members 

^Adopted by the Colorado State Board of Education in February, 1971* 

**Adopted by the Colorado State Board of Education in 1962. 
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revised and supplemented these exercises on the basis of field tests in the 
Spring, of 1970 before the field work in the Spring of 1971. 

Sampling . Random assignment of assessment forms to a randomly- 
selected sample of students provided performance indicators for all stu- 
dents in Colorado in Grades 3» 6, 9* snd 12, and students in certain popu- 
lation groups, i .e. , low income, minority, rural, etc. Exercises were 
sampled from these exercise pools: health, language arts, learner self- 

concept, mathematics, music, science and social studies. 

Analysis . Percentages of students making each response on the assess- 
ment exercises were listed for each of the 600+ exercises administered in 
1971 • Consistent with common practice, a 70% performance level was used as 
a "bench-mark" by which to judge students' capabilities. (Exceptions to 
this "bench-mark" are noted in Part III). 

Organizing the data . Exercises, along with the student performance 
data, were grouped under corresponding objectives. Objectives and exercises 
were then grouped by goal area. The data were displayed as follows: 



Object 


ive 


Objective 


GOAL #1 
Objective 


Ob jective 


Objective 


1. 


1 




1.2 


1.3 


• 1.4 


1.5 


Item 


1 


.1.1 


Item 1.2.1 


Item 1.3.1 


Item 1.4.1 


Item 1.5.1 


Item 


1 


.1.2 


Item 1.2.2 


Item 1.3.2 


Item 1.4.2 


Item 1 .5.2 


Item 


1 


.1.3 


Item 1.2.3 


Item 1.3.3 




Item 1.5.3 


1 tern 


1 


.1.4 


Item 1.2.4 


Item 1.3.4 




Item 1.5.4 


Item 


1 


.1.5 


Item 1.2.5 
Item 1.2.6 
Item 1.2.7 






Item 1.5.5 
1 tern 1.5.6 



Data regarding each of the six major Educational Goals for Colorado Citi - 
zens were similarly displayed. From these displays, this report was written, 
submitted for professional criticism, and revised for publication. 



Organization of This Report 

Four parts comprise this report: 
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Pa rt I : An introduction— -describing the nature of the assessment and 



the organization of the report. 

Part II : Conclusions — -brinqi nq together many bits of information 

regarding achievements and needs of learners in Colorado. 

Pa rt 111 : Typical results — »i 1 lust rating (1) what outcomes are com- 

monly desired in Colorado, (2) student performance in regard to these 
desired outcomes, and (3) judgments as to the adequacy of student perfor- 
mance. 

Pa rt IV : Appendix — giving the rationale of the Assessment, technical 

information, and methodology. 

II. CONCLUSIONS: 

OUTCOMES DESIRED AND OUTCOMES ACQUIRED 

Comparing goals and objectives (outcomes desired) with student per- 
formance (outcomes acquired) revealed certain learner achievements and 
certain learner needs in Colorado. Conclusions reached from these com- 
parisons are offered below. Specific examples and detailed analyses are 
contained in Part 1 1 1 of this report. 

Techniques of Learning 

Stated first in Educational Goals for Colorado Citizens* is . . . 
"each student in the State has the opportunity to acquire: 

- the TECHNIQUES OF LEARNING which make 
discovery of knowledge and wisdom a 
functional, exciting, and lifelong 
process." 

Objectives judged to be important by Colorado educators and which 
called for certain techniques of learning were found in the areas of 
language arts, science, social studies and mathematics. Student 

♦Adopted by the Colorado State Board of Education in 1971 
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performance on exercises relating to these objectives showed that some 
objectives have been achieved by most (more than 70%) of the students 
in Colorado, while other objectives have not been achieved by many (more 
than 30%) of the students. 

The conclusions that follow are presented as answers to the ques- 
tion "have students acquired techniques of learning which make the discov 
ery of knowledge and wisdom a functional, exciting, and lifelong process? 

Most (at least 70%) of students in Colorado appeared to be able - 

• to extract pieces of information from a table of contents ? 
and from statistical tables by Grade 3; 

• to select appropriate words to fit the context of simple 
sentences and to select appropriate sentences to fit the 
context of a paragraph by Grade 3; 

• to identify the topic sentence of a paragraph by Grade 6; 

• to identify appropriate uses of a dictionary and encyclo- ' 

pedia by Grade 6; 

• to predict the probable results from measuring the same 
thing several times by Grade 9; 

• to recognize verbs of sentences by Grade 12; 

• to distinguish fact from opinion in a letter to the editor 
of a newspaper by Grade 12; 

Many (more than 30%) of the students in Colorado appeared to be un- 
able to identify or recognize - 

• relative size of certain standard measures by Grade 3; 

• the mathematical procedures needed in certain practical 
problems at all grade levels; 

• the use of imagery in a literary passage by Grade 9; 

• the correct order in which certain historical events 
occurred by Grade 12; 

. a logical ly-correct sentence to complete a syllogism by 
Grade 12; 

• certain structural elements of mathematics by Grade 12; 

. subjects of sentences by Grade 12; 
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• analogies and hypotheses by Grade 12 

• scientific explanations for many natural phenomena by 
Grade 12; 

• geographic features,, distances, and alternative routes 
on a road map by Grade 12; 

Needs for certain "techniques of learning" were noted especially 
among learners from low-income, bi -lingual, low-education, and ethnic 
minority families. (See Part III of this report.) 

Skills of Doing 

Stated second in Educational Goals for Colorado Citizens is . . . 
"each student in the State has the opportunity to acquire: 

- the SKILLS OF DO I NG (computation, reading, 
intellectual, artistic, or physical perfor- 
mance) which produce satisfying participa- 
tion in worthwhile human activities." 

Objectives judged to be important by Colorado educators and which 
described specific "skills of doing which produce satisfying participation 
in worthwhile human activities" were found in the areas of mathematics, 
language arts, social studies, and music. Student performance revealed 
that most (over 70%) of the students in Colorado could: 

• do simple computations of adding, subtracting, multiplying, 
and dividing by Grade 6; 

• select words or phrases which are grammatically correct 
at all levels; (some exceptions to this are noted in 
Part III.) 

• predict probable effect of certain natural changes on a 
particular environment by Grade 9; 

• choose socially beneficial solutions to certain problems 
in human relations by Grade 9; 

• distinguish certain musical terms from non-musical terms 
by Grade 9; 

• select grammatically correct responses appropriate to 
ordinary conversation at Grades 9 and 12; 

• choose active musical participation over passive listen- 
ing or non-participation by Grade 12; 
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• estimate mathematical probability by Grade 12; 

Many (over 30%) of the students in Colorado could not - 

• compute prices, time-rate-distance, make change when 
given ordinary problem situations at all levels; 

• determine length by use of indirect measurement by 
Grade 6; 

• do simple computations with decimals and fractions by 
Grade 12; 

Needs for certain "skills of doing" were found most prevalent among 
certain pupil populations, notably those pupils from low-income families. 
(See Part 1 1 1 of this report.) 

Confidence of Knowing 

Stated third in Educational Goals for Colorado Citizens is . . . 
"each student in the State has the opportunity to acquire: 

- the CONFIDENCE OF KNOWING what is useful, 
relevant and meaningful to him." 

Objectives in the areas of social studies, learner self-concept, 
and music appeared to be related to "the confidence if knowing." 

Student performance on exercises demonstrating such learning is described 
below. 

Most (over 70%) of students in Colorado can - 

• select the styles of music which they enjoy and do not 
enjoy; 

Many (over 30%) of students in Colorado - 

• among certain population groups (See Part III) choose 
learnings "outside of school" to be those "most impor- 
tant for me to learn."; 

As this goal calls for considerable judgment regarding use, meaning, 
and relevance, the reader is encouraged to inspect the findings discussed 
in Part 1 1 1 to form his own conclusions as to whether students in Colo- 
rado have acquired "the Confidence of Knowing." 



1 
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Satisfaction of Earning 



Stated fourth in Educationai Goals for Colorado Citizens is . . . 
"each student in the State has the opportunity to acquire: 

- the SATISFACTION OF EARNING a contributing 
and rewarding place in the economic system." 

Most informative regarding this goal were student opinions of their 
own ability to learn to do tasks often associated with the world of work. 
Most (over 70%) reported they could already - 

• write a business letter by Grade 12; 

• make a long-distance phone call by Grade 12; 
and either could already or could learn to 

• run a cash register in a supermarket by Grade 12; 

• learn to speak enough German to work in a store in 
Germany within two years. 

More comprehensive facts regarding "Satisfaction of Earning" were 
collected in Colorado's 1970 Assessment. These results are reported in 
Assessing Educational Outcomes in Colorado (1970), available through the 
ERIC Retrieval System #ED 050 153. 

Capability of Being 

Stated fifth in Educational Goals for Colorado Citizens is . . . 
"each student in the State has the opportunity to acquire: 

- the CAPABILITY OF BEING a worthy person in 
his relationships to others and with 
himself." 

Objectives in the areas of social studies and learner self-concept 
appeared to contain descriptions of student capabilities relative to 
this goal. Most students (over 70%) reported themselves to be - 

• "above average" at learning things in school at all 
levels; 

• 'Ynost like" students who are capable of learning at 
Grades 6 and 9; 



• capable of learning reasonably demanding non-academic 

tasks at Grades 6, 9, and 12; 

J 

Results from social -studies exercises indicated that - 

• while eventually a majority (75% in Grade 12) of students 
in Colorado can identify a reason for school rules, per- 
formance levels are much lower in Grades 3 and 6; 

• most students (over 70%) demonstrated knowledge of 
various aspects of government including the rights 
of children under the United States Constitution by 
Grade 3; 

• many students (more than 30%) could not distinguish 
between the Declaration of Independence and the United 
States Constitution by Grade 12 as documents which 
secure their personal rights and freedom; 

Notable exceptions to these rather high performance rates were found 
among certain pupil populations. Typical findings included these facts: 

• girls reported less confidence than boys in their 
ability to learn fairly demanding academic tasks; 

• Chicano students and students from low-income families 
rated themselves lower on their ability to learn new 
things; 

• less boys than girls reported they thought they were 
learning useful things in school; 

Further information on "Capability of Being" is contained in 
Part 1 1 1 of this report. 

Joy of Feeling 

Stated sixth in Educational Goals for Colorado Citizens is . . . 



I 
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"each student in the State has the opportunity to acquire: 

- the JOY OF FEELING a sense of accomplishment, 
of contributing to the welfare of others, of 
having physical and mental well-being, of 
establishing satisfying friendships. 

Objectives in the areas of healthand learner self-concept appeared 
to be important in "having physical and mental well-being." 

Host (over 70%) of students in Colorado could - 

• identify single foods more nutritious than others by 
Grade 3; 
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• identify the dangers of smoking by Grade 3; 

• identify a necessary precaution with prescribed drugs 
by Grade 6; 

• identify a basic cause of obesity by Grade 9> 

• identify some personal and social effects of drug 
addiction by Grade 12; 

. predict they can learn to do reasonably demanding 
academic and non-academic tasks within several years; 

Many students in Colorado (over 30%) could not demonstrate know- 
ledge of - 

• a benefit of a relaxed atmosphere at mealtime by 
Grade 3; 

• the importance of regular vis i ts to the dentist by 
Grade 6; 

• the cause of obesity by Grade 9; 

. characteristics of mental illness by Grade 9; 

• common medical uses for certain drugs by Grade 12; 

. what is the most balanced among several menus by 
Grade 12; 

• a benefit of vigorous physical exercise by Grade 12; 

Critical Needs 



Certain critical needs were identified by (I) considering the im 

portance of a particular skill, knowledge, or attitude in achieving a 

desired goal and (2) the numbers of students lacking such learnings. 

Educational Goals for Colorado Citizens . 

Students in Colorado, in large majorities, could do simple 
computations of addition, subtraction, multiplication and 
division. The need is for applying these skills to prac- 
tical, everyday problems. Lacks in skills of application 
and understanding would appear to jeopardize the students' 
chances to enjoy "satisfying participation in worthwhile 
human activities" as described in a statewide Goal for edu- 
cation in Colorado. 

If students are to "make the discovery of knowledge and 
wisdom an exciting, functional, and lifelong process," 
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they need to strengthen certain skills in logical thinking, 
scientific processes, and measurement. Without such skills, 
the world may appear to these students to be more confusing 
and unhospitable than it actually is. 

Students' opinion of their own ability to learn appeared to 
be more related to their minority or economic status rather 
than their actual capabilities. Here, a need for self- 
understanding, especially among certain pupil populations, 
was indicated. 

Finally, certain pupil populations, especially those from 
families with low incomes, have far more than their share 
of difficulty with assessment exercises. The needs des- 
cribed in the above paragraphs are compounded when children 
have several needs instead of just one or two. Analysis of 
these needs is contained in Part III, which presents an 
item-by-item discussion of assessment results. 

The remainder of the report contains detailed information from which 
the reader may draw conclusions of his own regarding learner needs in 
Colorado. Cooperative consideration of this information may lead to 
increasing congruence of "outcomes desired" and "outcomes acquired" in 
the schools of Colorado. 



III. RESULTS: 

PUPIL PERFORMANCE ON ASSESSMENT EXERCISES 



Results of the Assessment are listed here to permit comparisons of 
two kinds: (I) comparisons of student performance (outcomes acquired) 

with goals and objectives (outcomes desired), and (2) comparisons of the 
performance of certain pupil population groups with the average for all 
students in Colorado. 

Student performance data indicated either general (a) achievement 
of desired skills, knowledge or attitudes, or (b) non-achievement. When 
achievement was in evidence, a statement to that effect was made and 
marked with a (+) sign. When non-achievement was in evidence, a state- 
ment to that effect was made and marked with a (-) sign. Tne reader may 
note that the percentages on certain exercises don't always add up to 100%; 
this is due to rounding or to student non-responses. 

A. LEARNING SKILLS 

The first two Educational Goals for Colorado Citizens describe 
long-range outcomes commonly desired in Colorado: 

Each student has the opportunity to acquire: 

the TECHNIQUES OF LEARNING which make discovery of 
knowledge and wisdom a functional, exciting, and 
lifelong process. 

{ the SKILLS OF DOING (computation, reading, intel- 

lectual, artistic, or physical performance) which 

| produce satisfying participation in worthwhile human 

activities. 

} 

• More specific descriptions of such learning skills were found in 

| 

1 year-end curricular objectives which had been judged to be important by 

| 

' Colorado educators. Skills commonly taught in language arts, mathematics, 

! and science appeared to be desirable to aid students to learn and to use 

what they have learned. 

O 11 

ERIC 




Language Arts - Grades 3 and 6 



Using contextual clues in reading, distinguishing fact from opinion, 
using sources of information, and identifying correct granvnar were skills 
found among commonly-desired objectives in elementary language arts. Stu- 
dent performance on exercises calling for these skills is discussed below. 

Using contextual clues . Students in third grade were given two 
reading exercises calling for them to identify words to fit the context 
of simple sentences. Students identifying the correct word demonstrated 
not only their knowledge of individual words, but a more general compre- 
hension of the meaning of the sentences. 



Bring me the 


from the shelf, please. 














1971 


a) 


house 


a) 


0 


2Z 


b) 


book 


* b) 


0 


93Z 


c) 


door 


c) 


0 


3Z 


d) 


dust 


d) 


0 


2Z 


Park the 


by the street. 














1971 


a) 


8 tar 


a) 


0 


1Z 


b) 


bench 


b) 


0 


2Z 


c) 


car 


* c) 


0 


94Z 


d) 


light 


d) 


0 


3Z 



(+) The high rate of correct response on these items (93%) and 
9^*%) indicates that Colorado students in third grade can, 
in fact, use contextual clues in reading simple sentences. 

Selecting a sentence consistent with the context of a paragraph was 

called for in other exercises such as this one: 



How does this story probably end? 






Tommy ate his lunch. He vent to the store. 


He 




looked at some toys and books. Then he vent 


to the 




sas station. There, he . 










1971 


a) played football. 


a) o 


11 


b) put air In his bike tires. * 


b) o 


891 


c) sang songs 


c) 0 


3Z 




(+) Results on this and two similar exercises indicate that 
the students in Grade 3 in Colorado can read with suf- 
ficient comprehension to identify a logical ending to 
a simple paragraph. 

Students' ability to put disorganized statements into historical 
sequence was demonstrated in this item. 



Read these sentences and answer the question 
below. 

a. Sammy ate the candy bar. 

b. Sammy bought his favorite kind of candy bar. 

c. Sammy found a dime on the sidewalk. 

d. Sammy went into a nearby candy store. 



1971 

6% 

751 

7Z 



If you wanted these sentences to tell a story, 
which sentence would come first? 



a) sentence "a" a) o 

b) sentence "b" b) o 

c) sentence "c" * c) o 

d) sentence "d" d) o 



(+) A clear majority of the students were able to identify 
the sentence which would come first in the story. 

Distinguishing fact from opinion . The abi I i ty to tel 1 whether a 

statement is factual or an expression of someone's opinion was demonstrated 

m this exercise. 



The Johnson family moved into a house with 


6 




bedrooms and each of the other 2 families i 


moved 




into houses with only 3 bedrooms. 










1971 


a) fact 


* a) o 


461 


b) opinion 


b) o 


49Z 


(nonresponse) 




6Z 


The Johnsons live in the nicest of the 3 houses. 








1971 


a) fact 


a) o 


“45z 


b) opinion 


*b)o 


51Z 


(nonresponse) 




4Z 



(-) The data for all exercises calling for the ability to 

distinguish fact and opinion indicate a correct-response 
percentage that can be accounted for almost entirely 
by chance guessing. 

Using information sources . Several exercises called for the stu- 
dents to identify and use certain sources of information to find answers 
to questions. 



To find out what a word means, children 


may 






a) 


look it up in the dictionary 


* a) 


o 


1971 

69Z 


b) 


look it up in an encyclopedia 


b) 


o 


10Z 


c) 


look at the word very hard 


c) 


o 


8Z 


d) 


skip it 


d) 


o 


8Z 




(nonrespondents) 




5Z 



3 

ERIC 



(-) Twenty-one percent of the students in Grade 3 not choos- 
ing either "dictionary" or "encyclopedia," would seem 
to indicate lacks in students' ability to identify infor- 
mation sources. 

(-) Other exercises showed that the two-step reasoning required 
to locate information from a book's table of contents is 
not attained by Colorado children in Grade 3. On a task • 
calling for first using a list of illustrations to find 
the page number of a certain picture, then looking on the 
table of contents to see which chapter contains that page, 
most students can only guess at the correct answer. Simi- 
lar results were obtained in the 1970 assessment in Colo- 
rado. 

Selecting correct usage . Skills identified as important to "pro- 
duce satisfying participation in worthwhile human activities" included 
the capability of selecting grammatically correct word forms. Typical 
exercises and student performance were as follows: 



% 23 












7 



'"i 

■A 



Joe and Sharon are now to the playground 

fence In a race! 











1971 


V 

}. 


a) 


run 


a) 


0 


5Z 


\ 


b) 


running 


* b) 


0 


91Z 


i 


c) 


runned 


c) 


0 


2Z 


1 


d) 


ranned 

i 


d) 


0 


2Z 


1 

l 


They have - 


‘ other races before this one. 




1971 


J 




- 






i 

( 


a) 


runned 


a) 


0 


8Z 


b) 


ranned 


b) 


o 


5Z 


i 

i 


c) 


ran 


c) 


0 


75Z 


* 


d) 


run 


* d) 


0 


12Z 


j 



(+) and (-) More students in Grade 3 were able to Identify cor- 
rect present-tense verbs than those in past-perfect 
tense. Other results on Grade 3 grammar exercises 
were similarly mixed. 

Several identical exercises given at both Grades 3 and 6 assessed 
students' ability to identify correct plurals and possessives: 



If this toy belongs 
toy Is . " 


to James, we can say, "This 
















1971 










G6 


G3 


a) 


James ' 


* a) 


0 


A2Z 


30Z 


b) 


Jameses 


b) 


0 


6Z 


17Z 


c) 


Jamese's 


c) 


0 


12Z 


A8Z 


d) 


Jame's 


d) 


0 


AOZ 


6Z 


When you have more 
several . 


than one penny, you may have 
















1971 










G6 


G3 


a) 


pennys 


a) 


0 


20Z 


29Z 


b) 


penny's 


b) 


0 


8Z 


17Z 


c) 


pennies 


* c) 


0 


69Z 


A8Z 


d) 


pennle 's 


d) 


0 


3Z 


6Z 



(-) Although more students in Grade 6 than in Grade 3 made cor- 
rect answers, many students finish elementary programs without 
competence to identify correct forms of plurals and possessives. 

On other exercises, the students In Grade 6 performed as follows: 



1 




(+) 83% chose "I don't doubt that" over "I don't doubt but 

that" and "can hardly run" over "can't hardly run." 

(+) 76% could identify topic sentences In two different 

paragraphs. 

(-) Only 50% (the chance guessing rate) chose "different 
from" over "different than," a result obtained also 
from students in Grade 9. 

(-) Less than two-thirds could identify the subjects and 

verbs of sentences, the tense (past, present, or future) 
of a verb. 

Language Arts - Grades 9 and 12 

Student performance on certain tasks of analysis and distinguishing 
correct from incorrect usage indicated the extent to which some of these 
"techniques of learning" and "skills of doing" were being acquired in 
Colorado schools. 

Distinguishing between correct and incorrect usage was requi red to 
successfully complete these exercises: 



Mark the one sentence which sounds the better of each pair below* 



a) Regardless of the price. I'll take it. 


a) 0 


82% 


b) 


Irregardless of the price. I'll take it. 


b) 0 


17Z 


a) 


They net my wife and I at the door* 


a) 0 


54% 


b) 


They net my wife and me at the door* 


b) 0 


40% 


a) 


While the days are hot, the nights 
are chill y. 


a) 0 


9% 


b) 


Although the days are hot, the nights 
chilly. 


b) 0 


85% 


a) 


He save a speech along the lines of 
good citizenship. 


a) 0 


16% 


b) 


He cave a speech about good citizenship. 


b) 0 


78% 



(+) Except for the common error in selecting 'Vny wife and I" 
in the second exercise above, consistently more than 
70% of the students in Grade 12 can distinguish between 
correct and incorrect usage. 

Selecting correct but appropriate replies to grammatically incor- 
rect questions was the problem posed by these exercises: 



16 



The next two questions are about what you would most likely 
do In certain situations. 



a. The situation: 

You are at a job Interview. During the summer you will need 
this job very badly as you will have to help out with expenses 
at home. If you get this job, you will have to drive the 
company truck and the owner must get partial Insurance for 
you. During the Interview he says, "I hope you ain't got 
any traffic tickets. 

What reply would you most likely give? 

1971 



a) 


"No, I ain't got any tickets." 


a) o 


gT2~ 

1% 


G9 

2% 


b) 


"I have received no traffic tickets." 


b) o 


292 


33% 


c) 


"No, I haven't.” 


* C> 0 


63% 


65% 


d) 


"No, I ain't." 


d) o 


1% 





b. The situation: 



You and two of your friends are talking .to a man who has come 
to your school to 'get volunteers for a hoccical service project 
he Is organizing. When he asks one of your friends to join, 
the friend says, "I don't got no time for that stuff." 



When he asks the second friend, the reply Is, "I don't got no 
time either." 



Finally he asks you. What reply would you most likely 
give? 



a) "I don't got no time either." a) o 

b) "I'm sorry, but I don't have the time." * b) o 

c) "Sorry, but I ain't got the time." c) o 

d) "I would most assuredly like to assist 
your worthy cause, but other commitments 
prevent my affiliation at this time." d) o 




12Z 16! 



(+) Most students selected grammatically correct responses 
to grammatically incorrect questions. Slightly over 
10% of the students chose responses which were gram- 
matically correct but generally too fancy for the or- 
dinary situation presented. 

Analyzing English composition . An identical exercise, calling for 
skills of analyses was given to students in Grades 9 ®nd 12 as follows: 




Read the following letter and answer questions about It. 

To the Editor: 

(a) Something must be done to reduce the carnage and slaughter 
on the highways In Colorado, (b) The yearly death toll has 
risen from 433 In 1960 to 687 In 1970. (c) I would like to 

see drivers with six violations on their record be removed 
from the road for good; after all, six fouls remove a pro 
player from the basketball court, (d) If the accident-prone 
drivers were removed from the road, the yearly death rate 
would probably go down on Colorado highways . 



f- 





ij 

£ 




Results obtained indicated that: 

( + ) 85% of ninth-grade and 91% of twelfth-grade students 

can find the statement of fact in the letter above. 

(-) Only half of the students for either grade could iden- 
tify the hypothesis, the analogy, and the author's 
likely purpose in the letter above. 

Other exercises not reproduced here indicated that: 

(+) Students in Grade 9 (74%) generally can identify verbs 
of sentences. 

(-) Students in Grade 9 generally cannot identify subjects 
of sentences. 

(-) Slight over half (55%) of the students in Grade 12 can 
select as different a sentence beginning with an inde- 
pendent clause from others beginning with a dependent 
clause. 

(”) Lass than half of the students in Grade 12 can recog- 
nize poetic imagery. 

Language Arts - Pupil Population Groups 

Performance of various pupil population groups was compared with 
statewide performance generally on all language arts items. The (-) 
indicates that the population group scored below the state average, the 
(+) indicates that the population group scored above the state average. 



18 
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TABLE 1 



AVERAGE PERCENT CORRECT ON LANGUAGE ARTS EXERCISES ; 
POPULATION GROUPS COMPARED TO STATE AVERAGE 
1971 SCHOOL YEAR 



Grades 





1 


6 


9 


11 


Sex: Boys 


-0.8 


-1.0 


-2.3 


-2.0 


Girls 


+1.5 


+1.2 


+2.6 


+1.4 


Ethnicity: Black 


-3.5 


-1.6 


-7.4 


-9.6 


Ch i cano 


-7.8 


-5.8 


-8.5 


-5.0 


Bi 1 ingual 


-10.3 


-4.5 


-8.4 


-7.0 


Father's Education: 










Grade School 


-8.2 


-6.7 


-4.4 


-2.0 


High School 


+1.8 


•K).2 


+0.9 


+0.4 


Col lege 




+4.9 


+3.5 


+2.7 


Family income: 










Less than $4500 


- 7.9 


-6.7 


-2.2 


-3.4 


$4500 -$9000 


+0.7 


••0.2 


-1.2 


+0.7 


More than $9000 


+4.6 


+3.4 


+2.6 


+2.1 


Community: Rural 


+1.2 


+0.5 


+1.7 


•K).8 


Res/ 1 nd/Com 


-3.3 


-1.8 


-3.2 


-4.9 


Residential 


+0.1 


+0.3 


+0.5 


+1.4 



Some tasks which appeared especially difficult for the low-performing 
population groups were as follows: 

Boys - using table of contents (Grade 3) 

« ■ 

Blacks - distinguishing fact and opinion (Grades 3 end 12) 
putting events into sequence (Grade 3) 
identifying subject of a sentence (Grade 9) 
word association (Grade 9) 

Chi canos - drawing conclusions (Grade 3) 

using table of contents (Grade 3) 
word association (Grade 9) 

Bilingual - reading skills (ail levels) 

Low i ncome - analysis of English composition (Grade 12) 

Residential /commercial /indust rial community - distinguishing sentence 

structure (Grade 12) 

Low Education - identifying factual statements (Grade 12) 



Mathematics - Grades 3 and 6 

"Techniques of learning" and "skills of doing" were also found to 
be described in some detail in year-end curricular objectives judged to 
be important by mathematics teachers in Colorado. These skills included 
not only simple computation, but also the application of rules, recogni- 
tion of structural elements and other tasks requiring conceptual under- 



standing of mathematics. 


Student performance 


on certain of these tasks 




is discussed below: 












Adding, subtracting. 


multiplying. 


and dividing. Student performance 




on simple computations was found 


to be 


as follows among students in 




Grades 3 and 6. 












TABLE 2 

MATH PERFORMANCE IN GRADES 


3 AND 6 




Thi rd Grade 


Correct 






Sixth Grade Correct 


Multiply 3 digits by 
1 digit 


77% 






Multiply 3-digits by 3 
digits 


83% 


Add two 3-digits 


89 % 






Add five 3-digits 


72% 


Subtract one 3-digits 
from another 3-d 1 gits 


60% 






Subtract one 4-dlglts 
from another 4-digits 


77% 


Multiply 3~digits by 
1 digit 


59% 






Multiply 3~digits by 
2 digits 


83% 


Divide 2-digits by 1-digit 


70% 






Divide 6-digits by 1-digit 


80% 



(+) As should be expected, there appears to be growth between 
Grades 3 and 6, with greater percentages of students doing 
more complex problems In Grade 6 than Grade 3# Multipli- 
cation appears to be a noteworthy growth area, however, % * 

(-) Between 15% and 25% of students in Colorado appear to 

finish Grade 6 without certain basic computational skills. 
Mistakes, possibly due to carelessness, appeared most 
prevalent in the addition and subtraction problems. 

Identifying standard measures . On exercises calling for demonstra- 
tion of understanding of certain measures, these findings were obtained 
for students in Grade 3! 



(+) 85 % indicated correctly that a year is longer than a 

day, week, or month. 

(-) Only 61% indicated correctly that a quart is smaller 
than a gallon, but larger than a cup and pint. 

(-) Only 31% could estimate the distance across Colorado 
in this exercise: 



Which choice best names the distance across the state of 
Colorado? 



a) 


four miles 


a) 


0 


1971 

5% 


b) 


forty miles 


b) 


0 


13% 


*c) 


four hundred miles 


* c) 


0 


31% 


d) 


four thousand miles 


d) 


0 


52% 



Among students in Grade 6: 

(-) Less than half of the students could distinguish be- 
tween cubic and square measures for describing the 
amount of air in a room. 

Computing time, rate, and distance . This exercise, given to stu- 
dents in Grade 6, called for students first to find the number of miles 
driven and then dividing by the number of gallons of gasoline used to 
find the gas mileage of a car: 



1971 

~Tti 

22 % 

32% 

18% 



(-) In this and simi lar exercises, Colorado students in 
Grade 6 responded correctly at about the rate of 
chance guessing. 

Skills of indirect measurement were assessed with this exercise: 



A man drove 60 miles per hour for 4 hours and used 
12 gallons of gas. How many miles did he drive on 
1 gallon of gas? 

a) 20 * a) o 

b) 15 b) o 

c) 5 c) o 

d) 3 d) o 



The two figures below represent two poles and their 
shadows formed by the sun: 



X ft. pole 



5 ft. pole 



6 ft. shadow 

How tall is the pole on the left? 



2 ft. shadow 







1971 


12 ft. 


a) o 


53% 


13 ft. 


b) o 


19% 


15 ft. 


* c) 0 


23% 


20 ft. 


d) o 


5% 



27% 



(~) Students in Grade 6 in Colorado were unable to use 
concepts of mathematical proportions in indirect 
measurement in the above problem. 

Finding information from a statistical table . Students in Grade 3 
were asked two questions, answers to which could be found or computed 
from a table. 



The table below shows how many students were in class 
for each day of a week. 

Mon Tues Wed Thurs Fri 



Boys 


15 


13 


10 


14 


11 


Girls 


14 


12 


15 


13 


12 



On what day were the fewest boys in class? 

a) Monday a) o 

b) Tuesday b) o 

c) Wednesday * c) o 

d) Thursday d) o 

e) Friday e) o 



1971 

"TO 

6 % 

65% 

3% 

13% 



On what day were the fewest students in class? 



a) Monday a) o 

b) Tuesday b) o 

c) Wednesday c) o 

d) Thursday d) o 

e) Friday * e) o 



8 % 

9% 

31% 

4% 

44% 



(-) Approximately one-third of students in Grade 3 could 
not find the lowest number for "boys" in the table 
and then see which day that lowest number was under. 

(-) Over half of the students could not find the total 
attendance for each day and identify the day with 
the lowest total. 

Selecting appropriate procedures . On the following exercise. . . 



1971 1970 

36% 39% 

36% 

26% 



(-) Students in Grade 3 show a lack of understanding that 
addition and subtraction are inverse (or opposite) 
operations. 

On different exercises ... 

(-) About half of the students in Grade 6 could identify 
the procedure to find the average height of a basket- 
ball team. 

(-) Only slightly more than half (57%) of Colorado stu- 
dents in Grade 6 indicated that multiplication, rather 
than addition, subtraction, or division, was the way 
to find the area of a truck bed when the length and 
width are known. Similar numbers of students in 
Grade 6 could correctly identify the two-step pro- 
cedure for finding the average height of a basket- 
bal 1 team. 

Computing prices , making change . Exercises calling for skills with 
money obtained these results: 



To solve 


the problem 34 + 1 j 


" 93 correctly, you can: 


a) 


subtract 34 from 93 


* a) o 


! b) 


add 34 to 93 


b) o 


c) 


subtract 93 from 34 


c) 0 



(-) Third-grade students performed at a level barely better 
than chance in identifying the price of 6 pens at a 
price of 2 for 25$. 

(-) Most students in Grade 6 could not identify the com- 
bination of coins which represents the change from 
a $3.95 (plus 19 cents tax) purchase with a five- 
doi lar bill. 

Applying concepts of pos i t i ve and negative numbers . 

(-) Most Colorado students in Grade 6 could not identify the 
number of degrees of temperature change between 20° 
above to 5° below zero. Many students incorrectly Iden- 
tified 15° as the correct answer. 

Mathematics - Grades 9 and 12 

Solving common problems, computations with fractions and decimals, 
identifying number relationships, identifying faulty logic, and identi- 
fying structural properties of mathematical systems were skills judged 
important by Colorado educators. The extent to which students in Grades 9 
and 12 have acquired these skills Is indicated in the assessment results 
discussed in this section. 

Solving common problems . Identical or similar exercises given in 
both Grade 9 and Grade 12 demonstrated various skills in solving pro- 
blems. 

Computing- 9th 12th 

Prices of ham* 41% correct 68% correct 

Car speed 42% " 61% " 

Cost of installment buying* 78% " 58% 11 

Return on investment 55% " 68% " 

★Different exercises for Grades 9 and 12. 

(-) Although there were more students In Grade 12 than In 

Grade 9 who made correct responses, it appeared that be- 
tween 30% end 40% of Colorado students finished Grade 12 
without being able to solve these problems of a prac- 
tical nature. 

Results on two exercises given only In Grade 9 obtained the following 



A pipe can empty a 175 gal* tank 


in 7 min. At what rate 




(gal./m! 


n.) does the pipe empty the tank? 


sf% 


a) 


25 gal . per min. 


*a) o 


b) 


168 gal. per min. 


b) o 


7% 


c) 


183 gal. per min. 


c) o 


3% 


d) 


1225 gal. per min. 


d) o 


3% 


A machine sorts 600 cards in one 


minute. How many cards 


does 


it sort 


per second? 




a) 


10 


*a) o 


1971 

75% 


b) 


3600 


b) o 


5% 


c) 


660 


c) o 


2% 


d) 


60 


d) o 


19% 



(+) Sizeable majorities of students in Grade 9 could find these 
rates of flow and card sorting. The second exercise, 
calling for knowledge that there are 60 seconds per min- 
ute, appeared more difficult. 

Identifying number relationships . Ninth-grade students' capability 
to indicate what happens to an element in an equation when a different 
element is changed was assessed by two items. 



1971 

“ 35 * 

45% 

18% 



What happens toQ in the number sentence A + □ 
when Zk gets larger? 


- 7 




a) Q gets smaller 


*a) o 


1971 

5U 


b) O gets larger 


b) o 


13% 


c) O stays the same 


c) o 


26% 


d) none of these 


d) o 


9% 



(-) The majority of students in Grade 9 did not appear to have 
the requisite understanding of number relationships to 
determine the effect of change in one element on another 
element. 




What happens to y in the following equation when x 
Increases? 

i(4) + 3-y 

a) y decreases * a) o 

b) y increases b) o 

c) y stays the same c) o 



Identifying structural properties . Similar exercises given to stu- 
dents in Grades 9 and 12 yielded these results: 

Grade 9: 



Select the property that is illustrated in the following 
equation 

4x(x3) » (4x8)x3 



a) 


associativity 


* a) o 


b) 


commutativity 


b) o 


c) 


dis tributivity 


c) 0 


d) 


identity element 


d) o 


e) 


inverse element 


e) o 



1971 

“3o% 

24% 

24% 

5% 

5% 



1970 

51% 



Grade 12: 



1971 1970 

10 % 

9% 

13% 

27% 

38% 50% 



(-) Considerably lower performances in 1971 than 1970 (not 
found in other areas) were evident on identifying struc- 
tural properties of mathematical equations. Rates of 
correct response dropped from approximately 50% to 40%. 

Computation with fractions and decimals . Simple computational 
skills requiring no application to a common- problem were assessed by 
such exercises as this: 



1971 1970 

12 % 

1 Vf 

62% 60% 
7% 



.42 * .0007 » 




a) 6 


a) o 


b) 60 


b) o 


c) 600 


* c) 0 


d) 6,000 


d) o 



a) 


associativity 


a) o 


b) 


commutativity 


b) 0 


c) 


distributivity 


c) 0 


d) 


identity element 


d) o 


e) 


inverse element 


*e) o 



(-) While this performance by Colorado students in Grade 12 
represents an improvement over performance of students 
in Grade 9, over one-third of students graduating from 
high school in Colorado appeared to have difficulty in 
computations with decimals. 

(-) Similarly, over one-third of Colorado students in Grade 12 
were unable to Identify the correct answer to 5/8 t 1/3 = ? 

Identifying true and faulty logic . Students in Grade 12 performed 
as follows on this exercise: 



1971 

23% 

4% 

72 % 



Another problem was as follows: "If it rains, then it will turn 

cold. It is raining." Sixty-seven percent concluded "it will turn cold." 
On another Item, 50% responded with "I might have a square" when given 
"All squares are rectangles, I have a rectangle. Therefore—," When 
given "If *p and q 1 is false, then:", 46% recognized "either p or q is 
false" as the right answer. 

(-) The results suggest that approximately one-half of the 
students in Colorado graduate from high school without 
developed abilities in logical thinking. 

Computing probability . Students in Grades 9 and 12 demonstrated 
skills in computing probability in exercises such as this: 



G£ G12 
5*% 75% 
27% 15% 
9% 3% 

9% 5% 



If a 6-s 1 ded die Is 


rolled, what is the probability 


of getting a 27 




a) 1/6 


* a) o 


b) 2/6 


b) o 


c) V6 


c) o 


d) 1/2 


d) o 



If it is 


a car, then it has four wheels. 


It has four 


wheels. 


Therefore 




a) 


it is a car 


a) o 


b) 


it is not a car 


b) o 


c) 


no conclusion 


* c) o 



(+) An Increase of 20% between Grades 9 and 12 shows con- 
siderable improvement and a fair mastery of this con- 
cept by Grade 12. 

Mathematics - Pupil Population Groups 

Performance of various pupil population groups was compared with 
statewide performances generally on all mathematics items. 



TABLE 3 

AVERAGE PERCENT CORRECT ON MATHEMATICS EXERCISES : 
POPULATION GROUPS COMPARED WITH STATE AVERAGE 



Grades 



1 i 2 li 



Sex: 


Boys 


0.0 


-0.3 


+2.3 


+0.8 




Girls 


-0.1 


+0.9 


-1 .8 


-1.1 


Ethnicity: 


Black 


-8.4 


-9.3 


-14.7 


-23.6 




Chicano 


-8.6 


-8.2 


-14.6 


-16.3 




Bi 1 ingual 


-8.0 


-5.7 


-14.5 


-11.6 


Father's Education: 

Grade School 


-8.6 


-7.3 


-5.9 


-5.9 




High School 


+0.6 


-0.3 


-2.0 


+2.0 




Col lege 


+4.3 


+6.6 


+9.2 


+2.9 


Family Income: 

Less than $4500 


-3.7 


0.0 


-6.2 


-7.0 




$4500- $9000 


+0.3 


-0.1 


+0.7 


+1.9 




More than $9000 


+5.4 


+6.0 


+9.1 


+6.4 


Community: 


Rural 


+2.1 


+3.1 


+2.9 


-0.7 




Res/ 1 nd/Com 


-7.3 


-3.6 


-4.8 


-3.1 




Residential 


+5.0 


+0.1 


+1.1 


+1.9 



Some tasks appeared particularly difficult for low-performing 
groups: 

Girls 

Computing time, rate, and distance (Grade 9) 

Computing probability (Grades 9 and 12) 



Blacks 



Finding information from a table (Grade 3) 

Adding 5 three-digit numbers (Grade 6) 

Computing cost of installment buying (Grade 9) 

Computing probability (Grade 9) 

Subtracting decimals (Grade 12) 

Computing probability (Grade 12) 

Ch 1 cano 

Identifying measures of quantity (Grade 3) 

Identifying appropriate procedures (Grade 6) 

Computing probability (Grade 9) 

Multiplying fractions (Grade 9) 

Identifying faulty logic (Grade 12) 

Identifying structural properties (Grade 12) 

B1 1 Ingual 

Identifying measures of quantity (Grade 3) 

Making change (Grade 3) 

Adding positive and negative numbers (Grade 6) 

Computing probability (Grade 9) 

Identifying structural properties (Grade 9) 

Identifying faulty logic (Grade 12) 

Computing rates (Grade 12) 

Low Family Education 

Identifying measures of quantity (Grade 3) 

Finding information from a table (Grade 3) 

Selecting correct procedure (Grade 6) 

Computing costs of installment buying (Grade 9) 

Computing probability (Grade 12) 

Identifying structural properties (Grade 12) 

Low Income 

Simple division (Grade 3) 

Selecting correct procedure (Grade 6) 

Computing probability (Grade 9) 

Identifying faulty logic (Grade 12) 

Residential /Commercial /Indust rial 

Finding information from a table (Grade 3) 

Selecting correct procedure (Grade 6) 

Computing rate (Grade 9) 

Identifying faulty logic (Grade 12) 

Science - Grades 3 and 6 

Scientific knowledge and scientific procedures enable students at 
all levels of development to "make the discovery of knowledge and wisdom 



a functional, exciting, and lifelong process." Understanding of natural 
phenomena, a systematic way to find things out, dealing effectively with 
the environment - all of these capabilities may be classified as learning 
skills. The extent to which students in Colorado have acquired some of 
these skills Is reported from findings from the statewide assessment. 

Demonstrating scientific curiosity . Students demonstrated their 
scientific curiosity and their knowledge on how to conduct an experiment 
in several exercises. 



Mary confeed her hair with her plastic comb. Then she held 
the comb above some pieces of Kleenex on the table and 
the Kleenex jumped up and stuck on the comb. Her friends 
who watched said the following things. Which thing is 
the most scientific: 

1971 
G6 G3 

a) "I do not believe what I saw." a) o 5% 14% 

b) "It's magic and can't be explained." b) o 6% 17% 

c) "The Kleenex wanted to jump up to the c) o 4% 12% 

comb." 

d) "I can't explain it, but there must be *d) o 84% 55% 

a reason why the Kleenex pieces jumped 

up to the comb." 



(+) Most students in Colorado, by the time they reached 

Grade 6, indicated correctly that there are scientific 
explanations for natural phenomena. Relatively few 
chose responses indicating belief in magic or general 
disbelief. 

Understanding the requirements of a scientific experiment was 
demonstrated by Colorado students in these exercises: 



Someone said that if you mix salt and sugar with water 
and let the mixture stand you get salt-water taffy — 
a kind of candy. Which of the following could be the 
best way for you to test this Idea? 

1971 









G6 


G3 


a) 


take a vote among your friends a) 


0 


2% 


7% 


b) 


buy some salt-water taffy and see If it b) 
has salt in it. 


0 


8% 


18% 


c) 


find out if salt and sugar have the same c) 
chemical In them 


0 


9% 


15% 


d) 


grind up some salt-water taffy to see If d) 


0 


4% 




e) 


try to mix salt, sugar, and water, let *e) 
stand, and see what happens 


0 


77% 


58% 



Tom wanted to find out whether plants can grow better in the 
dark or in the light. He put a pot with 6 radish seeds in 
a dark room and a pot with 6 bean seeds on the window 
sill. 

radish seeds bean seeds 

in the dark Wx-J in the ligt 

ib added the same amount of water to both pots. The bean seeds 
grew better than the radish seeds, so Tom said his plants 
grew best in the light. 




To be able to say this, he should have 

1971 
G6 G3 

a) watered both pots more a) o 6 % 15% 

b) watered the radish seeds more b) o 13% 16% 

c) put the same kinds of seeds in both pots*c) o 73% 43% 

d) grown the seeds in water instead of d) o 8% 22% 



(+) Despite the complexities of these exercises, majorities 
could identify the correct scientific procedure for the 
experiments described above. However, the 25% of the 
students in Grade 6 answering incorrectly represented 
some 10,000 young Coloradoans. 

Other exercises by which students demonstrated capabilities to en- 
gage in scientific processes were as follows: 

(-) Six-grade students generally could not identify what a 
scientific theory does (explains why some thins a'ct as 
they do). 



(-) Third-grade students attributed "bad luck" to breaking 
a mirror (24%) , walking under a ladder (16. 1%) , letting 
a black cat cross your path (28.0%) rather than to 
none of these (27.1%). 

(-) Only two-thirds of Colorado students in Grade 6 could 
identify mathematics as being more useful in scientific 
research than music, magic, marketing, or manufactur- 
ing. 

Explaining natural events . Students were given several exercises in 
which they could demonstrate their scientific knowledge in identifying 
reasons for certain natural phenomena. For example, students In Grade 6 
responded as follows to this exercise: 



A fossil of an ocean fish was found In a rock outcrop on 
a mountain. This probably means that 

1971 

a) fish once lived on the mountain a) o 7 % 

b) the relative humidity was once very high b) o 10Z 

c) the mountain was raised up after the *c) o 30Z 

fish died 

d) the fish used to be amphibians like d) o 8Z 

toads and frogs 

e) the f 08811 fish was probably carried to e) o 44Z 

the mountain by a great flood 



(-) Generally, students in Colorado have not, by Grade 6, 
gained the understanding of the pre-hlstoric formation 
of the continents. 

On other exercises, results indicated that 

(+) Most Colorado students in Grade 3 could correctly iden- 
tify the reason for day and night. (The earth turns.) 

(+) Most students in Grade 3 indicated correctly that babies 
come from their mother's body rather than the stork, the 
hospital, or the doctor. 

(+) A majority (87%) of students in Grade 6 correctly indi- 
cated that the earth needs plants for human survival. 

(-) Over half (58% of Colorado students In Grade 6 correctly 
identified erosion as a reason for some rocks being 
smooth. 

(-) About half (53%) of students in Grade 6 identified the 
purpose of a scientific theory as explaining natural 
events, or behavior. 
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Prevalence of superstition was assessed by this exercise: 



Which one of the following will cause you to have bad luck? 
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G? 


”G3 


a) 


breaking a mirror 


a) o 


8% 


24% 


b) 


walking under a ladder 


b) o 


5% 


16% 


c) 


letting a black cat cross your path 


c) 0 


5% 


28% 


d) 


none of these 


*d) o 


80% 


27% 



(+) Between Grades 3 and 6, approximately half of the stu- 
dents in Colorado seemed to learn that superstition 
provides little or no explanation for "bad luck." 

Other scientif i c knowledge and ski 11s . 

(-) Less than half (45%) of students in Grade 3 could 

identify how a tree, a worm, and a flower growing in 
a pot were similar. (They are all alive*) 

(-) Few students (less than one-third) in Grade 6 were 
able to identify the position of a block of wood 
floating in fresh water as compared to a block of 
wood floating in salt water (law of displacement). 

(-) One in three (one-thi rd) of Colorado students in 
Grade 6 could identify "housefly" as a carrier of 
disease. 

(+) 76% of students in Grade 6 could identify Einstein 

as the scientist in a list with other famous men. 

(+) A majority of students in Grade 6 (over 80%) could 
identify baking soda as useful for putting out a 
fire in the kitchen. 

Science Grades 9 and 12 

By completion of junior and senior high school, students should 
be able to use scientific processes and information to understand the 
world in which they find themselves. Assessment results indicated to 
what extent that this goal has been achieved. 

Identifying processes and procedures . Students demonstrated thei 
knowledge of one aspect of scientific measurement in this exercise: 



Whenever scientists carefully measure any quantity many 

tinea, thav ovnA/»f J J 



times, they expect that 
a) 



1971 

612 G9 



,, _ , GiZ 

all of the measurements will be exactly a) o 13% 
the same 

b) only two of the measurements will be b) o 6% 82 

exactly the sune 

c) all but one of the measurements will be c) o 6% 82 

exactly the same 

d) most of the measurements will be close * d) o 73% 732 

but not exactly the same 



(+) and (-) WhMe nearly three-fourths of students in Grade 12 
demonstrated their knowledge of the probable outcome 
of repeated measurements, this represented no super- 
iority over students completing Grade $i» 

Students' understanding of the use of a scientific model was assessed 
in this exercise: 



Wtat special meaning does the word "model" have when used 
in scientific terms like "the atomic model"? 



a) a structure made of plastic which you a) o 
can look at to see what an atom would 
look like if it was big enough to see 

b) a theory of how atoms are made which *b)o 
tries to explain why atoms act like 

they do 

c) a small scale copy of an atom c) o 

d) an idea of what the original atom d) o 

looked like before all other atoms 

were made 



1971 



612 G9 


40% 


402 


30% 


242 


17% 


232 


6% 


92 



(-) Few students could identify the purpose of a scientific 
model . 



An ability to generalize from a table of information was assessed in 
this exercise: 
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A doctor kept records of heart-beat rates of people when they were 
resting. He made the table below. 

Heart-beat Rates 



Person Beats In a minute 



Baby boys 


85 












7-yr. old girls 


80 












7-yr. old boys 


80 












iO-yr. old boys 


77 












mothers 

table shows that 


72 
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G-12 


G-9 


G-6 


a) boys' hearts beat faster than girls' 

b) girls' hearts beat faster than boys' 




a) 


0 


4% 


5% 


10% 




b) 


0 


2% 


3% 


5% 


c) older people's hearts beat faster than 


c) 


0 


4% 


3% 


8% 


younger people's 

d) younger people's hearts beat faster 


than 


*d) 


0 


88 % 


86% 


76% 



. older people ' s . 



(+) Most students by Grade 12 could check various statements against 
the information given and then decide which statement was sup- 
portable. 

Explaining natural phenomena . On exercises calling for scientific ex- 
planations of why certain things are the way they are, the following results 
were obtained: 

(+) Nearly two-thirds of students in Grade 9 correctly iden- 
tified the molecular explanation of the difference between 
solids, liquids, and gasses among untrue or partially 
true explanations. 

(-) Few students (less than one-third) in Grade 9 could find 
the temperature of the water after mixing 2 pints of 20°C 
and 1 pint of 80°C. (40°C) 

(-) Approximately half of the students in Grade 12 could iden- 
tify the statement demonstrating the Law of Conservation 
in explaining how a candle's flame heats a pan of water. 

(-) At least half of the students finishing Grade 12 could not 
identify correct explanations for: 

• Why giraffes have long necks (natural selection) 

. Why a fossil of a fish could be found on a mountain 
top (undersea volcanoes in prehistoric times) 

• Why some rocks are smooth and some aren't (erosion) 

. Why plants are needed on earth (to manufacture oxygen) 

• Why milk is pasteurized (to kill harmful bacteria) 
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• How marble was formed (heat and pressure) 

• Why continents haven't been washed into the sea 

(earth forces push land up at about the same rate 
as erosion) 

• Why mercury and glass is used in a thermometer (mercury 

expands more than glass when heated) 

• Why a sodium substance will turn yellow when heated 

(increased electron energy is given off as yellow 
light). 

Several exercises assessed student understanding of certain eco- 
logical relationships: 



In a particular meadow there are many rabbits that eat the 
grass. There are also many hawks that eat the rabbits. Last 
year a disease broke out among the rabbits and a great 
number of them died. Which of the following probably 
then occurred? 

1971 



a) 


the grass died and the hawk population 


a) 


o 


G12 

52 


' G9 
102 


b) 


decreased 

the grass died and the hawk population 


b) 


o 


32 


52 


c) 


Increased 

the grass grew taller and the hawk 


* c) 


0 


782 


582 


d) 


population decreased 

the grass grew taller and the hawk 


d) 


o 


42 


42 


e) 


population Increased 

neither the grass nor the hawks were 


e) 


o 


92 


222 



affected by the death of the rabbits 











' f. 

K! 




Which of the following would LEAST upset 
and plant life in a small area? 


the balance of animal 
1971 


a) 


burning a forest 


a) o 


32 


b) 


draining a swamp 


b) o 


32 


c) 


constructing a dam 


c) o 


42 


d) 


broadcasting radio waves 


* d) o 


872 


e) 


killing all hawks , awls, and vultures e) o 

in the area 


22 



(+) Understanding certain ecological relationships seemed to be 
prevalent among Colorado students in Grade 12. 
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Science - Pupil Population Groups 
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TABLE 4 

AVERAGE PERCENT CORRECT IN SCIENCE: 
POPULATION GROUPS COHPAREO WITH STATE AVERAGE* 



Grades 







1 


6 


l 


12 


Sex: 


Boys 

Girls 


-2.2 

+2.7 


40.4 

0.0 


+3.7 

-2.9 


+3.3 

-3.5 


Ethnicity: 


Black 


-11.7 


-17*6 


-13.2 


-12.0 


Chicano 


-6.2 


-8.3 


-7.4 


-19.0 




Bi lingual 


-12.9 


-11.0 


-12.3 


-19.7 


Father's Education: 


-14.0 


-15.6 


-4.2 


-4.6 




Grade School 




High School 


49.6 


40.8 


-0.5 


-0.3 




Col lege 


+10.1 


48.3 


44.6 


+7.3 


Family Income: 






-4.2 


-10.1 




Less than $4500 


-12.2 


12.0 




$4500-$9000 


+1.3 


-1.7 


44.3 


0.0 




More than $9000 


+5.7 


46.3 


46.2 


46.5 


Community: 


Rural 


-1.0 


+1.5 


44.3 


+1.7 


Res/Ind/Com 


-5.0 


-2.9 


-5.5 


-7.7 




Residential 


+1.4 


40.1 


40.4 


+1.5 



*See following page for example. 



B. LEARNER SELF-CONCEPT 

Educational Goals for Colorado Citizens , adopted by the State 

Board in 1971, includes this desired outcome from Colorado schools: 

each student has the opportunity to acquire: the 

capability of being a worthy person in his relationships 
with others and with himself. 

Performance objectives, also adopted by the Board and designed to 
enable students to attain long-range goals, included: 
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a. Our sun is a 

a) planet a) 0 

b) satellite b) 0 

c) solar system c) 0 

d) star * d) 0 


b. Which one of the following things often 
found in the kitchen could be used to 
put out fires? 

a) cooking oil a) 0 

b) baking soda * b) 0 

c) alcohol c) 0 

d) charcoal d) 0 
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All students shall show evidence of a self-concept which 

recognizes their individual strengths and weaknesses ... 

The intent of the Board is clear - along with knowledge and skills, 
students should acquire positive attitudes as well. Such an intent is 
consistent with findings from educational research which indicate that 
cognitive (knowledge and skills) learning and affective (attitudes) 
learning go hand in hand; achievement of one enhances the achievement of 
the other. 

The University of Colorado's Laboratory of Educational Research 
designed assessment forms by which students could report their views of 
themselves as learners. Specifically, personnel at the Laboratory pre- 
pared four performance-type objectives, which described what students 
would do to Indicate whether or not they had achieved a self-concept as 
a learner. The objectives specified these outcomes in terms of student 
performance: 

• The pupil will select such self -descriptors as "a good 
learner" from a list of descriptive statements. 

• The pupil will predict that he can learn reasonably de- 
manding academic work if he makes the effort to learn. 

• The pupil will identify himself with pupils who are 

capable of learning. 

• The pupil will express the opinion that he is capable 

of learning a number of moderately demanding non-academic 
skills (e.g., routine banking, long-distance calls) in 
the world outside of school. 

The Learner Self-Concept form was given at the same time as the other 
form on the same sampling basis In Grades 3, 6, 9, and 12. Results are 
reported below, first the statewide results and then by pupi 1 -population 
groups. 

Describing Self as Capable 

An identical question asked at all four grade levels obtained 



these responses: 



1971 



How good are you at learning things In school? 











G12 


G9 


G6 


G3 


a) 


among the worst 


a) 


0 


0 


1% 


1% 


3% 


b) 


poor 


b) 


0 


0 


1% 


1% 


3% 


c) 


below average 


c) 


0 


2% 


5% 


6% 


5% 


d) 


average 


d) 


0 


37% 


46% 


47% 


16% 


e) 


above average 


e) 


0 


23% 


19% 


13% 


9% 


f) 


good 


f) 


0 


24% 


22% 


21% 


42% 


g) 


among the best 


g) 


0 


11% 


6% 


11% 


18% 



(+) Large and increasing numbers of students reported them- 
selves to be average or above in their ability to learn 
things at school. 

(+) Increasing numbers of students between Grades 3 and 12 
saw themselves as average, with no students reporting 
themselves as "poor" or "among the worst" by Grade 12. 

(-) Among students at all levels, those from families with 
incomes under $4500 reported themselves as "good" 
rather than "among the best." 

(+) or (-) Persistently through Grade 9» between 7% and 10% reported 
themselves to be "below average." What happened to these 
students between Grades 9 and 12? Did they improve their 
self-concepts or did they drop out? 

(-) Among Chicano pupils in Grade 9» 60% reported themselves 
as "average" as compared with 46% of all pupils (Chicanos 
included). Only 25% of Chicano pupils in Grade 9 rated 
themselves "above average." 

(-) Students from low-education families also tended to rate 
themselves lower as learners at all levels. 

A question which did not, as was done in the above question, ask 
students to compare themselves with others was given to students in 
Grades 3 and 6 with these results: 



Are 


you like this? 


G6 


1971 


G3 




a) 


a good learner 


Yes 

73% 


No 

19% 


Yes 

70% 


No 

12% 


b) 


a poor learner 


11% 


79% 


13% 


65% 
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(-) Considerably more students in Grade 6 rated themselves 
as "poor learners" on this question than "below average" 
on the question discussed first in this section. 

(-) Rather high rates of non-response on this question may 
indicate either the question was confusing or that the 
students were reluctant to report whether or not they 
think they are "good learners." 

(-) As in the question before this one, students in Grade 3 
from lower-income families tended to rate themselves 
lower: 



Low income 


% Choosing "poor learners" 
25% 


Middle income 


12% 


High income 


7% 



(-) More girls than boys chose the "good learner" designation 
at both Grades 3 and 6. 

Predicting academic success . Several questions presented students 
with fairly complex learning tasks and then asked students to make pre- 
dictions about their ever being able to learn them. For example, this 
question received these responses from students in Grade 3: 



Look at the writing in the box, but don't read it carefully. 

"Four score and seven years ago our fathers brought 
forth on this continent a new nation, conceived In 
liberty and dedicated to the proposition that 
all men are created equal. Now we are engaged in 
a great Civil War, testing whether that nation or 
any nation so conceived and so dedicated can 
long endure." ' 

How old will you be before you can read and understand 
what's written in the box? 



a) 9 years old 


a) 


0 


1971 

"Hz' 


b) 11 years old 


b) 


0 


32Z 


c) 13 years old 


c) 


0 


14Z 


d) 15 years old 


d) 


0 


7Z 


e) 17 years old 


e) 


0 


9% 


f) I don't think I'll ever be able to 


f) 


0 


5% 


understand it 
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(+) Large numbers of third-grade students (95%) predicted 
that eventually they will be able to understand the 
f i rst pa rag raph of Lincoln's Gettyburgh Address . 

(-) When faced with a particular learning task, girls 

tended to be slightly less confident than boys in their 
eventual understanding of this passage. 

(-) Students from low income families tended to give more 
variable responses with higher percentages than the 
total population choosing, (a) "9 years old" and (b) 

"I don't think I'll ever be able to understand it." 

Students in Grades 6, 9» and 12 predicted their eventual capa- 
bility to solve a rather complex mathematical equation in this exercise: 



Problem 



cos x - 2 cos x + 1 ■ 0 



Find all values of x for which the above 
equation Is true. 



Do you think that you ever could learn enough math to 
correctly solve the above problem? 



a) yes 

b) no 

c) uncertain 

d) I already know how to solve it. 
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G9 


G6 


a) 


0 


542 


402 


b) 


0 


132 


82 


c) 


0 


282 


492 


d) 


0 


52 


32 



(+) There was less uncertainty at Grade 9 than at Grade 6 
as to whether students believed that they would ever 
be able to solve the above math problem. 

(-) At Grade 9» girls tended to be slightly less confi- 
dent than boys, a tendency which increased at Grade 12. 

Also at Grade 12, 31% of the boys and 21% of the girls 
reported they already knew how to solve the equation. 

In a question about learning German, the following results were ob- 
tained from students in Grade 9: 



If you went to live in Germany, how long do^ou think it would 
take you to learn to speak German well enough to work 
in a department store? 



a) 


less than 2 months 


a) 


0 


1971 

1* 


b) 


2 months 


b) 


0 


5% 


c) 


6 months 


c) 


0 


14% 


d) 


a year 


d) 


0 


32% 


e) 


2 years 


e) 


0 


30% 


f) 


4 years 


f) 


0 


11% 


g) 


more than 4 years 


g) 


0 


6% 



(+) The tendency of Chlcano pupils to express a slightly less 
confident assessment of themselves was not evident on 
this particular question. 

(-) The 17% who predicted "4 years" or "never" appeared to 
be unreal isticly high. 

identifying with capable learners . Students were given descriptions 
of four boys* learning ability and asked to identify the boy 'Vnost 
like" himself, identical items given at both sixth-grade and ninth- 
grade produced these results: 



John learned all of his lessons with ease. He hardly 
studied at all, but^still he learned everything and 
passed all of the tests with top grades. 

Bob worked hard to learn his lessons. When he didn't under- 
stand things right away, he would think hard and 
pretty soon he would know how to do the lesson. 

JIp tried hard to learn. But no matter how hard he tried, 
he couldn't seem to understand well enough to pass the 
teacher's test. 

Tom gave up trying to learn a long time ago. He used to 

try, but now he knows It Is just no use trying to learn all 
that stuff In those books. 

Which boy Is most like you? 
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a) 


John 


a) 


G9 

ol3% 


"G6 

15% 


b) 


Bob 


b) 


o56% 


61% 


c) 


Jim 


c) 


ol7% 


13% 


d) 


Tom 


d) 


o 3% 


4% 


e) 


None of them 


e) 


oll% 


8% 



(-) While a majority of the students ( 76 % in Grade 6 and 69 % 
in Grade 9) chose students as most capable of learning, 
at least approximately one-fifth (between 8,000 and 10,000) 
students at each grade level chose non-learners as 'Nnost 
like" themselves. 

(-) Little change or growth was noted between Grade 6 and 

Grade 9; students' self-confidence seemed pretty well set, 
possibly to their detriment. 



(-) Most apparent were relationships between level of father's 
education and choosing non-learners "Jim" and "Tom" as 
"most like" the students. 

Father's Education % Choosing "Jim" 

Less than Grade School 
Finished Grade School 
Finished High School 
Finished College 



37% 

31% 

16 % 

8 % 



(Differences between boys and girls were not appre- 
ciable on this question). 

Predi ctinq non-academic success . Students were asked whether or 
hot they could ever learn to do certain non-academic tasks. Results 



were as follows: 



Which of the following things do you think you could learn to 
do someday, IF YOU WANTED TO? 

To type on a typewriter 1971 

G12 G6 

a) Yes, I probably could learn to. If I a) o 87% 89% 

wanted to 

b) I'm not sure If I could b) o 1% 9% 

c) Ho, I probably couldn't learn to, even c) o 1% 2% 

If I wanted to 

d) I can already d) o 10% 

To speak French 1971 

Gl2~ G6 

a) Yes, I probably could learn to. If I a) o 65% 62% 

wanted to 

b) I'm not sure If I could b) o 12% 30% 

c) No, I probably couldn't learn to, even c) o 5% 7% 

If I wanted to 

d) I can already d) o 15% 



To work 


a cash register in a supermarket 
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a) 








G12 


G6 




Yes, 1 probably could learn to, if 1 
wanted to ' 


a) 


0 


65% 


89% 






b) 


1 'm not sure if 1 could 


b) 


0 


1% 


8% 




c) 


No, 1 probably couldn't learn to, even 
if 1 wanted to 


c) 


0 


1% 


3% 




d) 


1 can al ready 


d) 


0 


32% 




To 


make 


a long-distance phone call 






1971 




a) 








G12 


G6 




Yes, 1 probably could learn to, if 1 
wanted to 


a) 


0 


8.3% 


94% 






b) 


I'm not sure if 1 could 


b) 


0 


0% 


5% 




c) 


No, 1 probably couldn't learn to, even 
if 1 wanted to 


c) 


0 


0% 


1% 




d) 


1 can already 


d) 


0 


90% 




To 


write 


i a business letter 






1971 




a) 








G12 


G6 




Yes, 1 probably could learn to, if 1 
wanted to 


a) 


0 


17% 


81% 






b) 


I'm not sure if 1 could 


b) 


0 


1% 


16% 




c) 


No, 1 probably couldn't learn to, even 










d) 


if 1 wanted to 


c) 


0 


0% 


2% 




1 can already 


d) 


0 


80% 





(+) As would be hoped, there is less uncertainty and more 
confidence in learning certain non-academic tasks in 
Grade 12 than in Grade 6. 

Opinions of school activities, as reported by students in Grade 12, 
were indicated in this question. 



Check the one response which best describes your attitude toward learning in 



school : 






1971 


•) 


1 am learning a great deal in my classes which will be 
useful to me after graduation. 9. 


a) 


0 


37% 


b) 


1 do not care very much about learning in my classes 
as long as 1 can earn a passing grade. 


b) 


0 


3% 


c) 


1 could learn things from my classes if 1 wanted to but 
the most important things for me to learn are outside 
of school . 


c) 


0 


10% 
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<0 


1 like being in school even though 1 am not a very good 
lea rner. 


d) 


0 


4% 


e) 


School is a waste of time for me; 1 can hardly wait 
until graduation so that 1 won't have to learn any more 


e ) 


0 


1% 


f ) 


1 am not learning very much in school; 1 can hardly 
wait to get to college so 1 can take some interesting 
courses. 


f) 


0 


10% 


9) 


None of the above is a good description of my 
attitude. 


9) 


0 


32% 



(-) Forty-two percent (42%) of the girls as compared with 
31% of the boys chose "a" regarding the usefulness of 
things learned in school. 

(-) More rural than urban students chose the option "the 
most important things for me to learn are outside of 
school 

The high (32%) rate of selecting option "g" prevents any conclu- 
sions regarding student opinion statewide from this exercise. 



C. SOCIAL KNOWLEDGES ANO SKILLS 
Each of the Educational Goals for Colorado Citizens has a social 
dimension. For example, the 'Techniques of Learning" implies students' 
learning from a social situation as well as alone; the "Skills of Doing" 
include participation in social events; the "Capability of Being" in- 
volves relationships with others, and so on. 

More particularly a Performance Objective, adopted by the State 
Board concurrently with the goals, states as follows: 

For the student: 

All students shall acquire levels of knowledge of home, 
community, nation, and world which enable them to func- 
tion in a manner appropriate to their age and environ- 
ment. 



and for the student in relation to society: 

All students shall demonstrate a knowledge of and 
appreciation for a democratic form of government. 

The outcomes mentioned and implied in these goals and objectives des- 
cribe students who have acquired considerable social knowledges and skills. 
Knowledge (if not approval) of social conventions, social organization, 
interpersonal competence, and a sense of history are commonly deemed 
important in Colorado and are encompassed by the goals and objectives 
stated above. 

Assessment exercises were gathered from a variety of sources: 

National Assessment of Educational Progress (a pro- 
ject of the Education Commission of the States) - 
Citizenship 

Instructional Objectives Exchange (a project of ESEA 
Title III at tlie University of California at Los 
Angeles) - history, civics and geography 

Standardized Tests of Social Studies - ideas of 
items assessing various knowledges and skills in 
the social studies 

Student performance on these exercises was analyzed according to 
"Social Studies for Colorado Schools" a compendium of objectives col- 
lected and classified by consultants at the Colorado Department of Edu- 
cation in 1969 to be consistent with statewide educational goals as 
adopted by the State Board of Education. 

Map Reading 

At both the elementary and secondary levels students were given a 
portion of a map and then asked to find certain information from it. 

Grades 3 and 6. On an identical exercise given at both the 3rd 
and 6th grade levels, students performed as follows: 




Look at the map below and answer the questions about it. 




Which of the letters on the map above Is on an island? 



1971 









G3 


G6 


a) 


"A" 




a) o 31% 


12% 


b) 


"B" 




b) o 3% 


1% 


c) 


"C" 




c) o 3% 


1% 


d) 


"D" 




* d) o 56% 


84% 


Which of the letters on 


the map Is 


on a peninsula? 










1971 








G3 


G6 


a) 


"A" 




a) o 19% 


9% 


b) 


"B" 




b) o 25% 


22% 


c) 


"C" 




* c) o 34% 


64% 


d) 


"D" 




d) o 19% 


5% 


Which of the letters on 


tie map above 


Is on a 




gulf or bay? 
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G3 


G6 


a) 


"A" 




a) o 19% 


5% 


b) 


"B" 




* b) o 34% 


67% 


c) 


"C" 




c) o 32% 


26% 


d) 


"D" 




d) o 12% 


2% 



(+) Host (84%) of the students in Grade 6 could identify 
an island on a small map. Only slightly more than 
half of students in Grade 3 could do this. This 
indicated improvement in this ski 1 1 among students 
in their upper elementary years in Colorado schools. 

(-) Although considerably more students in Grade 6 than 
in Grade 3 could Identify a "peninsula," and a "bay," 
approximately one-third of the students still could 
not do this upon completion of Grade 6. 

G redes 2 and 12 . , On a portion of a road map (not reproduced here), 
students correctly found information at the following rates: 
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% Correct 



Task: 


G9 


G12 


Finding the number of roads crossing 
another 


92% 


94% 


Computing number of miles between towns 


45% 


40% 


Identifying correct directions from one 
town to another 


44% 


56% 



(-) While students in Grades 9 and 12 could count the num- 
ber of roads crossing another, the tasks of computing 
miles between towns and identifying correct directions 
appeared very difficult for the students. 

Demonstrating Knowledge of Social Organization 

Students demonstrated, via assessment exercises, their knowledge 
of certain facts of social organization. Included were exercises touch- 
ing on, (a) reasons for certain laws and social institutions, (b) poli- 
tical processes, and (c) miscellaneous facts of common knowledge. 

Reasons for laws . An identical exercise was given in Grades 3» 

6, and 12 with these results: 



The main reason there are school rules is 

1971 









G3 


_ G6 


G12 


a) 


to keep pupils from misbehaving 


a) 


o 35% 


36% 


9% 


b) 


to make pupils acts like adults want 


b) 


o 20% 


16% 


11% 




them to act 










c) 


to protect the rights of all 


* c) 


o 32% 


45% 


75% 


d) 


to make the teachers happy 


d) 


o 1% 


2% 


4% 



(-) While eventually a majority (75% in Grade 12) of Colorado 
students can identify the main reason for school rules, 
performance levels are much lower in Grades 3 and 6. 



The general purpose of Child Labor Laws is 


















1971 


a) 








G9 


G12 


to get jobs for needy children 


a) 


0 


14% 


6% 


b) 


to get teenagers to do some work 


b) 


0 


6% 


2% 


c) 


to protect children from hazardous or 
harmful experiences 


* c) 


0 


68% 


87% 


d) 


to protect employers from unqualified 
workers 


d) 


0 


10% 


4% 
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(+) A sizeable majority ( 87 %) of Colorado students, by 
high school graduation time, could identify the pur- 
pose of Child Labor Laws. 

(-) Sizeable numbers of students in Grade 9 , many of 
them employed or employable, probably did not know 
their rights and responsibilities under Child Labor 
legislation. 

Organization of government . A few exercises touched on facts of 
governmental organization. 



The capital of the United States Is 



a) 


New York 


a) 


0 


1971 

G3 

5% 


b) 


Denver 


b) 


0 


17% 


c) 


Washington, D.C. 


* c) 


0 


74% 


d) 


Colorado Springs 


d) 


0 


2% 



(+) Ability to identify the capital of the United States 
is indicated by approximately three-fourths of 
students in Grade 3. 

The Congress of theUnlted States Is made up of two 
parts. One Is the House of Representatives. What 



Is 


the other? 




G12 


a) 


Assembly 


a)o 


1% 


b) 


Electoral College 


b) 0 


0 


c) 


Senate 


* c) 0 


95% 


d) 


State Department 


d) 0 


0 


e) 


Supreme Court 


e) P 


4% 


When might a state have more Senators 
Representatives? 


than it has 


G12 


a) 


when it has a small area 


a) 0 


5% 


b) 


when it has a large area 


b) 0 


10% 


c) 


when it has a small population 


* c) 0 


50% 


d) 


when it has a large population 


d) 0 


34% 



(+) Knowledge of the electoral college among Colorado stu- 
dents in Grade 12 appeared to approach the 100% level. 

(-) Few students in Grade 12 have enough background know- 
ledge to identify when a state might have more Senators 
than Representatives. 
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The United States Constitution serves 


to protect 




children as well as grown-ups. 


1971 




G3 


G6 


a) true 


* a) o 762 


902 


b) false 


b) o 232 


92 



(+) Majorities of students in Colorado, by Grade 6, 

could identify a purpose of the Constitution regarding 
children as well as grown-ups. 

Other questions about the United States Constitution included 
the following: 



Free speech, free worship, and free press are promised 



to 


all American citizens in 












1971 








G6 


a) 


the Declaration of Independence 


a) 0 


422 


b) 


the United States Constitution 


* b) o 


442 


c) 


neither of the above 


c) 0 


142 



The Fourteenth Amendment to the United States Constitution 
limit 8 state police actions 



a) 


to standards of equal protection and 


* a) o 


G12 

572 


b) 


due process 

usually in time of national emergency 


b) o 


82 


c) 


only in cases of racial equality 


c) 0 


72 


d) 


none of the above 


d) 0 


262 



\ 



(-) Students in Colorado generally could not (a) distinguish 
between the Declaration of Independence and the Consti- 
tution in Grade 6,' or "(b)' identify the control of state 
actions by the Constitution in Grade 12. 

Legal processes . Elect ions, negotiations, and settling disagreements 
by legal means were processes which students, were called. upon to iden- 
tify in the assessment exercises. 
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How 


did Governor Love get to be Governor? 


















1971 










G3 


G6 


a) 


he was elected 


* a) 


0 


67% 


90% 


b) 


he was hired 


b) 


Q 


7% 


1% 


c) 


he was appointed 


c) 


0 


12% 


6% 


d) 


his father was Governor 


d) 


0 


13% 


2% 



(+) By Grade 6, most students could Identify how the 
Governor became Governor. 



What Is the political party of President Nixon? 



a) Democrat 

b) Republican 

c) Independent 

d) Other 




What Is the political party of Governor Love? 



a) Republican 

b) Democrat 

c) Independent 

d) Other 



* a) 

b) 

c) 

d) 



1971 

“g r 

o 55% 
o 28% 
o 11% 
o 6% 



(-) Most students In Grade 6 could not identify the political 
party of the President or the Governor currently In 
office. 



On other exercises dealing with legal processes, students per 
formed as follows: 



(-) Approximately half of the students in Grade 12 could identify 
why workers organize into labor unions (To bargain with em- 
ployers). 



1 +) 



Approximately three-fourths of students In Grade 9 
J D?£!« Court! 9 "' ° f aPPM ' b V 



(+) 



Virtually no child In Grade 6 could identify his right 
to attend school without paying tuition. 9 



Most students identified why it is good to have at 
least two candidates for an office (So people can have 
a choice). 



The appropriate legal process to settle a possible disagreement was 
in question on this exercise: 

Before very long, men may go from Earth to Mars 
in rockets • Both the United States and Russia may 
be planning to send men to Mars. Whoever gets to 
Mars first may say that Mars belongs to their 
country and that other countries can't send people 
there. Before this happens, What do you think the 
governments of our country and Russia should do 
about It? 

G9 



a) 


Have a race and the winner would own 
Mars 


a) o 


2% 


b) 


Right to Mars should be settled In 
advance by International agreement 


*b) o 


73% 


c) 


Eight over It and the winner gets the 
biggest share 


c) 0 


1% 


d) 


I don't know 


d) o 


23% 



(+) Students in Grade 9, in large numbers, chose a legal 
solution to the problem of the ownership of Mars. 

Also, some 23% admitted, "I don't know" to this com- 
plex and relatively new problem. 

Identifying Appropriate Social Processes 

Students in Grade 9 were given descriptions of various social 

situations and then asked "What would you do?" 




You belong to a club. A person of another race wants 
to join your club. Some of the other club members 
are doubtful about admitting that person because of 
his race. You ^ 

a) don't want any problems so you make up a) o 2% 
an excuse to tell the person. 

b) suggest that all members get to know the b) o * 802! 
Individual, and then decide on club 

membership 

c) leave the dub If the person were admitted c) o 2% 

d) none of the above d ) 0 



(+) Only 4% of these students chose unsocial or devious 
solutions to the problem regarding matters of inter- 
racial relations. 

On other situations given students in Grade 9: 

(+) Over two-thirds chose to ask the reason for a particu- 
lar ruling on student dress rather than either refusing 
to comply or letting the issue drop. 
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(-) Only half of the students in Grade 9 would take the 
opportunity to travel to another city and live with 
another family for a month. 

(-) Less than half of the students in Grade 9 would ac- 
cept a nomination to class office if a friend also 
wants the office. 

Historical Perspective 



Exercises which asked students to identify a period of time or to 
put events into sequence were also Included in this section. 



How long has the United States of America been 
a nation? 

1971 







G3 


~G6 


a) 


100 years 


a) o 16% 


14% 


b) 


200 years 


* b) o 14% 


36% 


c) 


400 years 


c) o 26% 


30% 


d) 


1500 years 


d) o 43% 


20% 



(-) Although there appears to be increased awareness of 
the age of the United States between Grades 3 and 6, 
over two-thirds of the students in Grade 6 still 
guessed wrong on this exercise. By Grade 12, only 
70% could identify the approximate age of the United 
States. 



In what chronological order did the following 
events occur? 

King John signed the Magna Carta In England 
Plato wrote his Republic In Greece. 

Hammurabi set down written law In Babylonia 

John Hancock signed the Declaration of Independence In America 

1971 

G6 G9 G12 

a) King John, Plato, John Hancock, Hammurabi a) o 16Z 8% 2Z 

b) Plato, Hammaurabi, King John, John Hancock b) o 23% 23% 21% 

c) Hammurabi, Plato, King John, John Hancock *c) o 33% 52% 69% 

d) none of the* above d) o 26% 13% 5% 



(+) By Grade 12, a considerable but not impressive number 
of students could put these historical events into 
their order of occurrence. 

Performance on All Exercises by Pupil Population Groups 

Performance of several pupil population groups was compared to per- 
formance of all students on social knowledges and skills items. The (-) 
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indicates the population group scored below the state average; the (+) 
indicates the population group scored above the state average. Response 
patterns found in mathematics, science, health, and language arts 
appeared also In the social studies exercises. The minority students, 



TABLE 6 

AVERAGE PERCENT CORRECT ON SOCIAL STUDIES EXERCISES : 
PUPIL POPULATION GROUPS COMPAREO WITH STATE AVERAGE 



Grades 



Sex: 


Boys 


I 

•*0.7 


6 

+1.7 


a 

+1.6 


12 

4-2.2 




Gl rl s 


-0.5 


-1.4 


-1.7 


-1.6 


Ethnicity: 


Black 


-11.5 


-4.2 


-12.7 


-16.3 


Chlcano 


-7.8 


-7.7 


-9.8 


-5.6 




Bilingual 


-7.0 


-9.7 


-11.2 


-7.8 


Father's Education: 

Grade School 


-7.3 


-7.3 


-5.6 


-1.7 




High School 


0.0 


-0.1 


40.2 


40.3 




Col lege 


•♦6.4 


+3.9 


44.7 


+2.5 


Family Income: 

Less than $4500 


-6.1 


-5.6 


-11.2 


-7.2 




$4500-$9000 


40.6 


-0.3 


+2.5 


0.0 




More than $9000 


■*4.2 


45.7 


+7.8 


+3.6 


Commun i ty : 


Rural 


-3.7 


40.5 


+1.8 


4-2.4 


Res/ 1 nd/Com 


-4.4 


—2.2 


-1.3 


-2.8 




Residential 


■*0.9 


0.0 


-0.6 


*0.3 


students 


from low-1 ncome and low-education 


families, 


and from In- 





dustrlal communities scored consistently lower. 



0. HEALTH INFORMATION 

Educational Goals for Colorado Citizens , as adopted by the Colorado 
State Board of Education, calls for opportunities for each student to 
acqut re *, 
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the CONFIDENCE OF KNOWING what is useful, relevant 
and meaningful for him. 

And more specifically related to students' health and physical well 
being. Performance Objectives (adopted concurrently with the Educational 
Goals) specify that 

All students shall demonstrate continuing physical 
development appropriate to their individual strengths 
and weaknesses. 

Still more specifically, objectives judged to be important by 
educators in Colorado describe student behaviors which indicate that 
students have, in fact, acquired health information important to physi- 
cal development and well-being. These objectives, among other things, 
specify that students should have information useful: 

• to Identify healthful eating habits; 

• to distinguish between practices beneficial and harmful 
to physical strength and health; 

• to recognize harmful and beneficial uses of drugs; 

• to demonstrate knowledge of disease and mental illness; 

. to identify important dental care practices; 

Exercises in which students demonstrated whether or not such In- 
formation has been acquired were given to students in Grades 3, 6, 9, 
and 12 on a statewide sample. Performance of students on these exercises 
is discussed below. 

Grade Three 

Children in these young, formative years make daily choices which 
bear on their present and future well-being. Their responses on various 
exercises calling for health information is one indication of the type 
of choices they would make in various situations. 

Identifying healthful eating habits . Students in Grade 3 selected 
nutritious meals as follows: 
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Which of the following snacks would be best for 
you? 



a) cake and potato chips a) o 

b) cake and 7-Up b) o 

c) candy bar c) o 

d) milk and cookies * d) o 



1971 

-“ 5 % 

1155 

4Z 

78Z 



jimmy eats only 0 good cereal for breakfast, lunch 
and supper. BcrtSfov eats fruit, meat, bread and 
vegetables every day. Who will grow up to be 
healthier? 

1971 

a) Jimmy •) o 14Z 

b) Bobby * b) o 84Z 



(+) Given choices among foods and eating habits, sub- 
stantia) majorities of students in Grade 3 could iden- 
tify the most nutritious. 

(-) Ability to select the most nutritious meal (first 

exercise above) appeared to be related to the income 
level of the student's family: 



Gross Yearly Income 


Percent Answering Item 


of Pupils' Family 


b Correctly 


Under $4,500 


6355 


Between $4,500 & $9,000 


7855 


Over $9,000 


85Z 



Actually eating the food once it was selected was touched upon 
in exercises such as these: 



It Is a good Idea to wash your food down 
wa ter so that you don't have to chew so much. 



a) true 

b) false 



a) o 
* b) o 



If a person gets very mad or excited while he Is 
eating, he might get sick to his stomach. 



a) true 
hi false 



* a) o 
b) o 



1971 1970 

"34 f Z9Z 
6555 7155 



1971 1970 

lOZ 691 

2955 3155 



56 66 



(+) Majorities of students in Grade 3 appeared to be know- 
ledgeable about the importance of chewing food and a 
relaxed atmosphere at mealtime. 

Recognizing physically beneficial practices . An exercise calling 
for students to recognize the beneficial effects of vigorous physical 
exercise received the following responses from students in Grade 3. 



Billy played hard every day and was tired every night 
before bed. Jimmy sat quietly in his house all day 
and never got tired. Who probably will be healthier 
when he grows up? 



a) 

b) 



Billy 

Jimmy 




(+) Majorities of students in Grade 3 could identify the 

more active of two children as the one most likely to be 
healthier when he grows up. 

Recognizing harmful effects of smoking . Early information on 
smoking was assessed by this item: 



People who smoke cigarettes all their lives will be just 
as healthy as people who never smoke cigarettes. 

v 1971 

a) true a ) 0 ”11% 

*>> fal8e * b) o 86% 



(+) Students 8 and 9 years old appeared to know that cigar- 
ettes are harmful to peoples 1 health. 

Identifying practices of dental care . Tooth-brushing and visiting 
a dentist were the subjects of these two exercises: 



People don't need to go 


to a dentist unless they have 




a bad toothache. 




a) true 

b) false 


a) o 
* b) o 


1971 
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Betty eats lots of candy and does not brush her teeth. 

Sally does not eat candy and she brushes her teeth at 
night and In the morning. Who may get cavities and 
have fillings In her teeth? 

1971 

a) Betty * a) o 81% 

b) Sally b) o 18% 



(-) Importance of seeing a dentist was not in evi- 
dence among students in Grade 3» especially those 
from lower-income families: 



Family Income 

Under $4500 
$4500-$9000 
Over $9000 



% Correct 

50% 

65% 

80 % 



Recoon i z i nq correct uses of d rugs . Knowledge about drugs and 
their uses or effects was assessed in exercises such as these: 



1 

1 


js can be taken as medicine If 






1971 


a) 


the doctor says to take them. 


* a) 


o 




b) 


you feel sick and need them. 


b) 


o 


8% 


c) 


you want to take them. 


c) 


o 


7% 


d) 


people should never take them. 


d) 


o 


16% 


Taking drugs 
















1971 


a) 


makes you happy. 


a) 


o 




b) 


can be a habit. 


*b) 


o 


74% 


c) 


both (a) and (b) are true 


c) 


o 


17% 
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Mrs. Jones was sick. She went to the doctor; he gave 
her some pills that made her well. Mrs. Smith felt 
sick. Mrs. Jones let Mrs. Smith borrow her pills. 

Old Mrs . Jones do the right- thing? 



a) 

b) 



yes 

no 



•) 

* b) 



Will all pills make you feel good when you take them? 



a) 

b) 



yes 

no 



a) o 
* b) o 



1971 




27% 




72% 




1971 


1970 


22% 


25% 


77% 


75% 



(+) Certain minimal precautions associated with the use 
of drugs and medicines seemed to have bden learned 
by a majority of pupils by the end of third grade. 

(+) Students in Grade 3 exhibited a fairly high rate of 
trust in professional expertise with the use of 
drugs. 

(-) A significantly large percentage of pupils considered 
sharing of prescribed medicines the "right thing" to 
do. 

(-) Apparently, large numbers of students in Grade 3 
incorrectly thought that all pills will make them 
feel good. 



Grade Six 

Students in Grade 6, hopefully, will show more knowledge of 
health practices important to their physical and mental well being. 
Assessment results are informative as to whether thiswas the case in 
Colorado. 

Identifying healthful eating habits . As in Grade 3, students 
were asked to identify among several choices the most nutritious meals 
and healthful eating habits. 



Drinking coffee makes a person healthier. 







1971 








G6 


G3 


true 


a) o 


5f 


227. 


false 


* b) o 


95% 


76% 




(+) Misconceptions about coffee held in Grade 3 appeared 
to be overcome by Grade 6 in Colorado. 



Which one of the fdLlowing lunches represents the 






most balanced diet? 






1971 


1970 


a) 


hamburger, potato chips, cookies, and 
pop 


a) 


o 


3% 




b) 


hamburger, carrots, pickles, and tomato 
juice 


b) 


o 


41% 




c) 


ham sandwich, french fries, and a milk 
shake 


c) 


o 


4% 




d) 


ham sandwich, potato salad, an orange * 
green beans, and a milk shake 


d) 


o 


53% 


58% 



(-) Consistently, students in Grade 6 could not identify 
the combination of food most healthful among several 
choices. Again, performance of students from low- 
income families was considerably lower on an exercise 
dealing with nutrition. 

Two exercises asked students to demonstrate knowledge of diet in 
connection with being fat: 



Most people are fat because 

1971 

a) they're bom that way; It runs In a) o 15% 

their family. 

b) they eat more calories than they burn * b) o 52% 
up by work or exercise. 

c) they eat the wrong kinds of foods c) o 33% 




(-) Approximately half of the students in Grade 6 attributed 
being fat to the simple practice of eating more calories 
than are used. The 15% selecting the hereditary explana- 
tion might well believe that being fat is beyond a person's 
control. The one-third selecting a dietary explanation 
apparently had only partial knowledge. These misconcep- 
tions appeared among girls more than boys though in low- 
income more than high-income groups. 

(-) Almost one-third of Colorado students in Grade 6 indi- 
cated incorrectly that potatoes contain more fat than 
cream. 
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Recognizing physically beneficial practices . Exercises deal ing with 
physical fitness obtained these results: 



What Is the best thing to do 
lungs and heart? 


to have healthy 






a) sleep and rest 

b) eat the right food 

c) get lots of exercise 

d) take a bath every day 


a) 0 

b) 0 
* c) 0 

d) 0 


1971 

*12% 

13% 

73% 

2% 


1970 

66% 


It is not good for your body to run and play so hard 
that you get tired and out of breath. 




a) true 

b) falsa 


a) 0 
* b) 0 


1971 

48% 

52% 


1970 

~54% 

46% 



(-) Students in Grade 6 appeared to be somewhat uncertain or mis- 
informed about the benefits of physical exercise. While 73% 
rated "lots of exercise" as most important for healthy lungs 
and heart, only 52% (no better than random guessing) 
recognized that getting tired and out of breath was not 
bad for you. 

(-) On an item not reproduced here, half of the students in 
Grade 6 demonstrated the misconception that face-washing 
was sufficient to prevent acne or facial blemishes among 
youth. 

D emonstrating knowledge of disease and mental illness . On Items not 
reproduced here, of the students in Grade 6 

(+) 88% correctly identified immunization as the best way to 

keep from getting polio, measles, small -pox. 

(+) 71% diagnosed a mole that was growing In size and changing 

color as a possible sign of cancer. 

(+) 72% chose "germ control" as the explanation of why many foods 

require refrigeration. 

Recognizing dangers of smoking and drugs . Comparisons between 1970 
and 71 and Grade 3 and Grade 6 were made on this exercise: 



People who amoke cigarettes all their lives will 


be lust 






as healthy as people who never smoke cigarettes. 














1971 




1970 


a) true 




gS 


G3 


“G6~ 


a) 0 


4% 


12% 


3% 


b) false i 


fc b) 0 


96% 


86% 


97% 



(+) Knowledge of the dangers of smoking appeared to be prevalent 
among children between the ages of 9 and 12. 

Growth- rate in students' knowledge of drugs may be observed on these 
e>terc i ses : 



Some drugs can be taken as medicine If 

1971 



a) 


the doctor says to take them 


* a) 


o 


G6 

89% 


“G3 

67% 


b) 


you feel sick and need them 


b) 


o 


6% 


8% 


c) 


you want to take them 


c) 


o 


2% 


7% 


d) 


people should never take them 


d) 


o 


3% 


16% 



1970 

G6 

5% 

95% 



Mrs. Jones was sick. She went to the doctor; he 
gave her some pills that made her well. Mrs. Smith 
felt sick. Mrs. Jones let Mrs. Smith borrow her 
pills. Did Mrs. Jones do the right thing? 

1971 
G6 G3 

a) yes a) o 5% 27% 

t>> no * b) o 95% 72% 



(+) By Grade 6, students appeared to be increasingly knowledgeable 
about use and misuse of drugs. 

(-) A tendency for poor, urban, and ethnic minority students to 
indicate that people should never take drugs was noted in 
the assessment results. 

Grade Nine 

During the years of rapid change and growth, students' knowledge about 
factors influencing their health would seem crucial to attaining the goal 
stated at the outset of this section. 






m 
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Identifying healthful eating habits . Students were asked to identify 
healthful foods separately and in combination: 
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Which one of the following drinks 


does not make a person 




healthier? 












1971 


1970 


a) milk 


a) o 


2% 




b) orange juice 


b) o 


1% 




c) chocolate milk 


c) o 


14% 




d) tea 


* d) o 


82% 


82% 


Which one of the following breakfasts is best for 






your health? 












1971 




a) cereal, donut, coffee 


a) o 


1% 




b) cereal, eggs, toast, tea 


b) o 


16% 




c) cereal, orange, bacon, milk 


* c) o 


66% 




d} cereal, pancakes, toast, milk 


d) o 


16% 





(+) Large majorities of students in Grade 9 could identify tea among 
a list of other drinks as one that does not make a person 
heal thier. 

(-) Almost one-third of the students in Grade 9 could not iden- 
tify the most nutritious breakfast menu among four alternatives. 

On other items, 

(-) Students in Grade 9, like those in Grade 6, could not (a) 
identify a food with the most fat content, or (b) correctly 
attribute being fat to eating more calories than are used. 

Demonstrating knowledge of physical fitness , growth , and development . 

Students in Grade 9 responded to several exercises in this area as follows: 



If a child will eat only the right kinds of food, 
he will not have pimples. 



a) true 

b) false 





1971 


1970 




G9 G6 




a) o 


18% 44% 


16% 


b) o 


82% 56% 


84% 



63 



73 



(+) Considerably more students in Grade 9 (82%) than in Grade 6 
(56%) correctly indicated that pimples may be caused by 
factors other than diet. 

Other items produced these results: 

(+) 96 % recognized as false the statement that girls can become 

pregnant before age 18. 

(+) 88% identified immunization as the best way to prevent com- 

municable diseases-. 

(-) Many (46%) students in Grade 9 incorrectly indicated that 
there is immunization against tuberculosis. 

(-) Many (54%) consider, even at Grade 9, "much physical work" 
as harmful to the body: 



Which one of the following is not harmful to your body? 


1971 


1971 

Bojrs 


Girls 


a) 


heavy smoking of cigarettes a) 0 


1% 


2% 


1% 


b) 


much physical work * b) 0 


43% 


53% 


33% 


c) 


heavy drinking of water c) 0 


2% 


3% 


1% 


d) 


consuming many more calories than you d) 0 

need 


1% 


1% 


0 


c) 


all of the above are harmful to the body e) 0 


54% 


42% 


65% 



Recognizing dangers of drugs . Results indicated that 

(+) Large majorities of students recognized that 

. drugs may be taken on a doctor's prescription 
. glue sniffing can do bodily damage 
. heroin is the most dangerous of several drugs 

Grade Twelve 

Exercises given at lower grades along with exercises assessing knowledge 
of certain drugs comprised the form completed by students in Grade 12. 

Nutrition and weight control .. Selecting nutritious meals and 
identifying reasons for being fat were asked of students in these exercises: 



♦ 



Most fat people are fat because 






1971 




1970 


a) 


They f re born that way; it runs 




G12 


G9 


G6 G12 ' 


G9 


a) o 


5% 


9% 


15% 


b) 


In their family. 




they eat more calories than 
they burn up by work or 
exercise 


*b) o 


751 


68% 


52% 72% 


73% 






c) 


they eat the wrong kinds of 
foods 


c) o 


18% 


21% 


33% 




Which one of the following breakfasts Is best for 






your health? 




















1971 




a) 








G12 


G9 




cereal, donut, coffee 




a) 


o 1% 


1% 




b) 


cereal, eggs, toast, tea 




b) 


o 18% 


16% 




c) 


cereal, oranges, bacon, milk 




c) 


o 71% 


66% 




d) 


cereal, pancakes, toast, milk 




d) 


o 8% 


16% 





(-) Although steady progress was made from Grade 6 through Grade 
12 in dispelling misconceptions surrounding obesity, by the 
time Colorado pupils finished high school, only two-thirds 
could indicate (without guessing) that being fat is caused by 
imbalance of input of calories and output of energy. 

(+) The inheritance explanation of obesity was almost gone by 
Grade 12. 

(+) A majority, but not an impressive one, could identify the 
one most nutritious breakfast among four choices. 



Demonstrating knowledge of physical growth and development . Compar i son 
of Grade 12 with Grade 9 results were made on these exercises: 



If a child will eat only the right kinds 
he will not have pimples. 


of food, 






1971 


a) True 


G12 


G9 


a) o 12% 


18% 


b) False 


* b) o 86% 


82% 



Girls cannot become pregnant and have a baby 








until they are over 18 years old. 










a) True 


a) o 


$ §? 






b) False 


* b) o 


98% 96% 






Which one of the following is not harmful 


to 








your body? 




1971 Boys 


Girls 


a) heavy smoking of cigarettes 


a) o 


1% 


2% 


0 


b) much physical work 


* b) o 


38% 


46% 


31% 


c) heavy drinking of beer 


c> o 


0 


1% 


0 


d) consuming many more calories than you 


d) o 


2% 


3% 


1% 


need 










e) all of the above are harmful to your 


e) o 


56% 


45% 


64% 


body 











« 



(-) The majority of pupils at Grade 12 continued to believe that 
much physical work is harmful to the body. 

(-) Many students in Grade 12 and in Grade 9 indicated incorrectly 
that a good diet is sufficient to prevent pimples. 

Disease prevention . Results of various public information programs 

may be estimated from the results on these items: 



Many kinds Of cancer can be cured If they 


are discovered 






early and treated, 
a) true 


* a) o 


1971 

"91% 


1970 

94% 




b) false 


b) o 


9% 


6% 




Being In the sun too long for many years can make 
your skin dry and wrinkled and can even cause skin 
cancer. 


1971 


Boys 


Girls 


a) true 


* a) o 


78% 


70% 


85% 


b) false 


b) o 


21% 


29% 


14% 



(+) The possible harm of over-exposure to sun and the benefits of 
early detection were recognized in relation to cancer by 
majorities of students in Grade 9. 
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Other exercises indicated: 



(+) Immunization was considered by twelfth-grade students as the 
best protection against certain communicable diseases. 

(-) The misconception that there is immunization (shots) for 
tuberculosis persisted among Colorado students in Grades 
9 and 12. 

Knowledge of menta I i 1 1 ness . Comparisons among grade levels were 



made on these items: 



Most mental Illness Is Inherited; a person Is bom 
with a mental problem and It comes out when he 








Is older. 








1971 




1970 




G12 


G9 


G12 


G9 


a) true a) o 15% 


27% 


20% 


26% 


b) false * b) o 82% 


71% 


78% 


72% 


Most people who are mentally 111 are very dangerous 
people and should be kept locked up. 


1971 






G12 


G9 


‘ G6 


G3 


a) true a) 0 20% 


18% 


35% 


38% 


b) false * b) o 80% 


82% 


64% 


60% 



(-) Approximately one in five students graduating from Colorado 
high schools (a) attributed mental illness to heredity, and 
(b) indicated most mentally ill people are dangerous. Little 
improvement was noted between Grades 9 and 12 on this latter 
misconception. 

Drug information . Exercises calling for knowledge of legal/illegal, 
harmful/beneficial or habitual uses of drugs obtained these results for 
students in Grade 12: 



One of the earliest known and still most useful 
drugs for relief of extreme pain Is called 


1971 


a) methadone 


a) o 


“17% 


b) amphetamine 


b) o 


10% 


c) opium 


* c) o 


22% 


d) none of these 


d) o 


49% 



A drug frequently used In dieting and weight control 


1 8 




1971 


a) amphetamine 


* a) o 


30% 


b) paregoric 


b) o 


15% 


c) oaffelne 


c) 0 


13% 


d) none of these 


d) o 


39% 


A very valuable drug used for control of epilepsy , 




high blood pressure and Insomnia Is 


called 


1971 


a) codein 


a) o 


2Z 


b) phenobarbltal 


* b) o 


63% 


c) meperdine 


c) 0 


11% 


d) none of these 


d) o 


22% 


A drug which may be purchased In many states without 


prescription providing It meets the 


federal standard 


as an exempt narcotic Is called 




1971 


a) hashish 


a) o 


2% 


b) codeine 


* b) o 


63% 


c) morphine 


c) 0 


11% 


4) none of these 


d) o 


22% 




Habitual use of drugs can lead to 




1971 


a) personal unhappiness 


a) o 


“7% 


b) community disorganization 


b) o 


1% 


c) financial loss 


c) 0 


2% 


d) all of these 


*d) o 


82% 


e) none of these 


e) o 


5% 



(-) Medical and legal information called for by these items was 
not conspicuously high among students in Grade 12. Chance 
guessing probably accounted for most correct answers that 
amphetamine was useful in weight control. 

(+) General knowledge of possible consequences of taking drugs 
habi tual ly was generally prevalent in graduating seniors in 
Colorado high schools. 



Pupil Population Groups , performance of certain pupil population 
groups was compared to performance of the total state population at Grades 
3, 6, 9, and 12. The (-) indicates the population group scored below the 
state average, the (+) indicates the population group scored above the state 
average. 



Table 7 

AVERAGE PERCENT CORRECT ON HEALTH EXERCISES: 
POPULATION GROUPS COMPARED TO STATE AVERAGE 



Grade 





3 


6 


9 


12 


Sex : Boys 


-2.7 


-0.1 


-2.1 


-1.4 


Girls 


+3.0 


+0.2 


+2.0 


+1.1 


Ethnicity: Black 


-2.4 


-7.6 


-6.7 


-2.4 


Chicano 


-9.3 


-5.3 


-3.8 


-6.4 


Bi 1 ingual 


-6.8 


-7.2 


-5.2 


-11.3 


Father's Education: 


Grade School 


-3.6 


-3.8 


-1.5 


+1.2 


High School 


-1.6 


+0.2 


+0.9 


+1.5 


Col lege 


+5.4 


+2.2 


+3.0 


+0.7 


Family Income: 


Less than $4500 


-4.3 


-6.1 


-2.3 


-4.0 


$4500-$9000 


-1.2 


-0.3 


+2.5 


+1.8 


More than $9 , 000 


+6.7 


+3.4 


+0.8 


+1.9 


Community: Rural 


+0.5 


+2.8 


+0.7 


+2.0 


Re s/I nd/Comm 


-5.3 


-1.9 


-1.0 


-3.6 


Residential 


+0.8 


-0.3 


+0.2 


. +0.8 



Familiar effects were noted: Boys generally scored lower than the 

state average as did students from minori ty, low-education and low-income 
families as well as students living in Residential/Industrial/Commercial 
areas. Further analysis may reveal in more detail what specific exercises 
were the most difficult for the various pupil population groups. 
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E. APPRECIATING MUSIC 



Educational Goals for Colorado Citizens describes as desirable those 

opportunities for students to acquire 

. skills of doing - including artistic performance 

. confidence of knowing - including what is personally relevant 

. a joy of feeling - including physical and mental well-being 

Performance objectives, also adopted by the State Board specify that 

All students shall, according to their ability and interest, 
enjoy a variety of experiences in the cultural arts (includ- 
ing music) 

Consistent with these goals and objectives and those objectives, judged 
to be important by music teachers in Colorado schools, assessment exercises 
were constructed. Personnel from the Colorado Music Teachers Association 
advised in the exercise development. The music exercises were administered 
in May 1971 concurrently with the exercises in the six other areas. Results 
are summarized below in terms of three common objectives: 

1. Valuing music as self expression 

2. Liking music of various types and styles 

3. Valuing music for itself 
Valuing Music as Self Expression 

Students demonstrated their interest in participating in musical 
activities by responding to various questions. 

Grade Three . Three questions were asked in Grade 3 about instrumental 

music: 
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Would you be willing to save part of your allowance 
to buy a musical instrument, If someone would teach you 
to play It? 



«) yes a) o 67% 

b) no b) o 16% 

c) I'm not sure c) o 17% 



Would you practice 30 minutes every day in order to 
learn to play a musical instrument? 

a) yes a) o 66% 

b) no b) o 16% 

c) I'm not sure c) o 18% 



Would you like to learn 


to play a musical Instrument? 




a) 


yes 


a) o 


76% 


b) 


no 


b) o 


12% 


c) 


I'm not sure 


c) o 


12% 



(+) Large majorities of students in grade 3 indicated they were 

willing to spend time and money on learning to play an instrument. 
Less than one-fifth of all students indicated no such willingness 
with an equal number uncertain. 

Regarding vocal music, students in Grade 3 responded as follows: 



Do you like to sing songs? 


a) yes 


a) o 


78% 


b) no 


b) o 


12% 


c) I'm not sure 


c) o 


9% 


Do you ever sing parts of songs 


to yourself when you 




are alone? 


a) yes 


a) o 


78% 


b) no 


b) o 


16% 


c) I'm not sure 


c) o 


5% 



(+) Singing, like playing an instrument, was valued by most 
students in Grade 3 in Colorado. 



Grade Six . Interest in performing musically was touched upon with 



these questions for students in sixth grade: 



Do you think you would enjoy being able to sing 
well if you can't already? 



yes 


a) 


0 


80% 


no 


b) 


0 


10% 


1 , m not sure 


c) 


0 


10% 



If you had a choice, would you prefer to: 



a) 


listen to a musical performance 


a) 


0 


24% 


b) 


participate in a musical performance 


b) 


0 


50% 


c) 


I wouldn't want to do either 


c) 


0 


10% 


d) 


I'm not sure 


d) 


0 


16% 



(+) Interest remained high in Grade 6 in active participation in 
music. Participation was preferred to listening approximately 
two to one. 

Grades Nine and Twelve . Several questions asked students in Grades 
9 and 12 were related to valuing music as self expression: 



If you grew up and had children 
to give them music lessons? 


to raise, would you want 


G9 


G12 


a) yes 


a) o 


38% 


53% 


b) no 


b) o 


14% 


8% 


c) I'm not sure 


c) 0 


47% 


33% 


(nonresnonse) 




2% 


6% 



(+) Considerably more students in Grade 12 than in Grade 9 valued 
music enough to expect to want any future children of theirs 
to have lessons. 
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Choosing activities for spare time was asked students at grade- 
levels 9 and 12 in this exercise: 



Make a check mark beside the one thing you would most 
like to do with your spare time. 



a) 


Read a book 


a) o 


G9 

12% 


G12 

22% 


b) 


Listen to music 


b) 0 


26% 


26% 


c) 


Play a sport 


c) 0 


46% 


38% 


d) 


Watch television 


d‘, o 


11% 


12% 




(nonresponse) 




5% 


2% 



72 



82 



(+) or (-) Listening to music was more popular than either reading a 
book or watching television among students in Grade 9, but 
less popular than playing a sport. (Perhaps more informative 
would be comparing choices of particioati no in music and par- 
ticipating in sports.) 

Pupil population groups . Preferences for certain kinds of music 
among certain population groups may indicate valuing music as a means of 
self-expression by students in Colorado. 

(+) Minority and urban children preferred soul music 

(+) Rural children preferred western music 

(+) Non-minority children preferred rock music 

In ninth grade 

(+) Blacks enjoyed religious music, soul music and, to a certain 
extent, jazz 

(+) Chi canos enjoyed Mexican folk music, soul music 

(+) Non-minority or majority students enjoyed rock, folk and to 
some extent Broadway show music, chamber music, and symphonic 

(-) Consistently, from 10 % to 30 % less boys than girls gave posi- 
tive responses to musical participation and listening. 

Liking Music of Various Types 

The extent to which students enjoy music of various types was indicated 
in their responses to certain questions. 



I enjoy listening on the radio 


to 














G6 




G9 






G12 




OK 


Turn it 


OK Turn it 


OK 


Turn it 






off 




off 




off 


Hard rock 


75% 


23% 


91% 


8% 


89% 


10% 


symphonic music (such as 


32% 


67% 


24% 


73% 


44% 


53% 


Beethoven) 














religious music 


48% 


51% 


30% 


64% 


28% 


68% 


soul music (such as Aretha 


60% 


39% 


64% 


32% 


67% 


31% 


Franklin or James Brown) 














Mexican folk music 


50% 


49% 


22% 


72% 


23% 


73% 


Grand opera (such as 


24% 


75% 


9% 


86% 


13% 


84% 


Rigoletto) 














American folk music 


69% 


30% 


46% 


48% 


65% 


31% 


country and western 


66% 


34% 


42% 


52% 


45% 


51% 


Broadway show music (such as 


54% 


44% 


43% 


53% 


64% 


33% 


Hello Dolly) 














Chanber music 


22% 


76% 


17% 


76% 


30% 


65% 


jazz 


79% 


20% 


60% 


36% 


68% 


29% 



(+) Higher percentages of students in Grade 12 than in Grade 6 
enjoyed listening to symphonic, soul, Broadway show, and 
chamber music. 

(-) Most students graduated from high schools in Colorado without 
having learned to enjoy symphonic music, rel igious music, 
Mexican folk music, country and western music, and chamber 
mus i c . 

The extent to which students have gained familiarity with various 
musical terms is shown below. (Some nonsense terms, i .e. , "molto nebuloso" 



were included as a check against indiscriminate marking) 



Hark each musical term that you have heard before 



concerto 

Dixieland 

ragtime 

symphony 

confetti 

adagio 

add rock 

sonata 

jam session 

gavotte 

marlachi 

bluegrass 

folk 

cantata 

Molto nebuloso 



Have Heard of 



G6 


G9 


G12 


38% 


79% 


89% 


82% 


89% 


91% 


59% 


83% 


90% 


86% 


96% 


93% 


23% 


19% 


20% 


17% 


19% 


32% 


40% , 


72% 


84% 


32% 


53% 


72% 


39% 


76% 


84% 


13% 


12% 


16% 


20% 


24% 


33% 


43% 


52% 


65% 


92% 


95% 


94% 


22% 


37% 


56% 


9% 


6% 


9% 



Haven* t Heard of 



G6 


G9 


G12 


61% 


19% 


6% 


18% 


9% 


4% 


40% 


15% 


6% 


14% 


3% 


3% 


76% 


79% 


75% 


83% 


77% 


63% 


59% 


26% 


11% 


67% 


43% 


23% 


60% 


22% 


10% 


85% 


86% 


78% 


79% 


73% 


61% 


56% 


45% 


29% 


7% 


3% 


1% 


77% 


60% 


39% 


89% 


91% 


86% 



(+) Recognition of more technical terms such as "sonata," "concerto", 
and "cantata" increased between Grade 6 and )2. This was found 
especially true among the girls. 

(-) Considerable unfamiliarity was found among boys and ethnic 
minorities, notably Chicanos. 

Valuing Music For Itself 

A few exercises touched on students' val u i ng music in and out of school. 



1 think that music is important 







a) 

b) 


yes 


a) o 


G3 

58% 


no 

1 9 m not sure 


b) o 


15% 


c) 


c) o 


26% 




Music is important in our lives 






a) 

L \ 


yes 


a) o 


66 

62% 




no 

1 , m not sure 


b) o 


11% 


c) 


c) o 


27% 






Every school should tssch its pupils about music. 



a) yes 

b) no 

c) I'm not sure 
(nonresponse) 



a) o 66% 

b) o 9% 

c) o 22% 

3% 



(+) or (~) While less than 70% of students in Grades 3 and 6 indicated 
"yes" to the importance of music, less than 20% indicated 
"no"; many were not sure. 
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APPENDICES 



RATIONALE, METHODOLOGY, 

AND 

AN INVENTORY OF EDUCATIONAL OUTCOMES 
DESIRED IN COLORADO 




APPENDIX A 



RATIONALE, PURPOSES, AND ACTIVITIES 
OF THE ASSESSMENT 



A few assumptions underlying Colorado's Assessment Program are listed 
below to aid the reader's understanding of the program's design and operation. 
Throughout the program, much careful work was directed toward making the 
assessment consistent both with evaluation theory and political feasibility 
toward improving educational opportunities for children in Colorado. 

I . EXAMINATION ANi) IMPROVEMENT OF GOALS 

Rationale of Assessment : 

Educational goals take on importance and meaning if those developing 
the goals realize that subsequent assessment and evaluation will 
indicate the extent to which the goals are being achieved. 

Educational goals, adopted by the State Board of Education, indicate 
statewide beliefs as to what schools should do for students. Local 
goals may supplement state goals, identifying unique needs of stu- 
dents within a school or district. Taken together, local and state 
goals, define "quality education". 

Educational goals may, from time to. time, be revised to more adequately 
represent common educational beliefs, informed by results of prior 
assessments based on goals. 

Purposes of Assessment : 

1. To demonstrate goals as working documents in 
the conduct of educational endeavors. 

2. To determine the extent of consensus on goals 
presently stated for Colorado. 

3. To encourage local districts to supplement 
statewide goals, identifying unique needs of 
students within a district or school. 

4. To provide whatever information is helpful in 
revising, from time to time, statewide educa- 
tional goals. 

Activities Completed : 

1. Identification of student needs regarding 
Goals For Education In Colorado (1970). 

2. Revision of statewide goals (1971). 
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2. I DENT1F1Y1NG PERFORMANCE OBJECTIVES 



Rationale of Assessment : 

Professional judgment, informed by experience and research, can 
identify capabilities which students need in order to enjoy the 
benefits mentioned and implied in educational goals. Continued 
refinement and revision may be made on the basis of new information 
and experience. 

Statements of objectives, specifying what students should be able 
to do as a result of schooling may guide program development and 
evaluation. 

Objectives may describe capabilities in specific performance 
terms expected at various points in the educational program and 
[ students' educational careers. 

Purposes of the assessment : 

1 . To demonstrate procedures of stating and using 
j performance objectives to achieve more general 

| goa 1 s . 

| 2. To identify performance object i ves commonly 

j considered important statewide in various 

curriculum areas. 

3. To refine objectives for increased relevance 
to goals and amenability to measurement. 

i Activities Completed : 

l 

1. Judgment of year-end objectives by a sample 
| of Colorado teachers (1969). 

j 2. Refinement of objectives according to teacher 

I judgment (1970) and results of assessment 

; ( 1971 ). 

t 

3. Collection of objectives from various sources 
\ for sharing with local districts. 
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3. DETERMINING THE EXTENT TO WHICH PERFORMANCE OBJECTIVES ARE BEING 
ACCOMPLISHED 



Rationale of Assessment • 

Local district may judge what information being collected state- 
wide is informative regarding local goals and objectives. State 

averages may provide one reference point by which local results mav 
be intPrnrpfpH 7 



Criterion-referenced tests may be used to describe capabilities — 
what students can do and cannot do. Norm- referenced tests may be 
used to compare certain scores to average scores. Both approaches 
may be considered in determining the extent to which performance ob- 
Jectives are being achieved. 

Sampling provides information on groups (not individuals) useful in 
assessing general program effectiveness in reaching stated objectives 
Costs of sampling are a fraction of every-pupil testing. 

Purposes of Assessment ; 

1. To demonstrate procedures to create test exercises 
measuring the extent to which objectives are being 
achieved. 

2 . To determine status of learners in Colorado re- 
garding the extent to which goals and objectives 
are being achieved. 

Activities Completed ; 

1. Development of criterion-referenced item pools in 
nine common curricular areas ( 1969 - 72 ). 

2 . Administration of exercises on a sampling basis to 
30,000 students in Colorado (1970 S 71 ). 

3. ^fined instruments and sampling procedures on the 
bfe-sis of results and experiences ( 1970 - 72 ). 

4. Developed operational analysis program on state 
computer. 



4. REPORTING 



Rationale of the Assessment: 



The Colorado General Assembly makes legislative decisions of great 
importance to education in Colorado. Information regarding needs 
of students, as developed by statewide assessment, may inform 
those decisions regarding general and special support. Continuing 
assessment may reveal impact of state actions in terms of increased 
student achievement and other indicators of "quality education". 

Purposes of this Assessment : 

1. To report educational needs with the precision and 
relevance needed for decision-making at various 
levels of responsibility. 

2. To solicit and receive feedback regarding reports 
sent to the Colorado General Assembly. 

Activities Completed : 



1. Written and oral reports regarding statewide 
assessment results. 

2. Advise on accountability and related information. 

3. Fall testing under the Accountabi 1 ity Act, Reports 
to Districts. 

5. ASSISTING LOCAL SCHOOL DISTRICTS 

;/ 

Rationale -*of Assessment: 



f- Processes and procedures of stating goals and objectives, designing 

I measures and reporting results have been designed for both state 

;■ and local applicability. Each district may adopt or adapt any of 

V: these methods useful in local programs. 

State assessment in no way replaces or relieves local authority and 
responsi bi 1 ity for continuing and improving local efforts in this 
| area. Communication among all levels of responsibility is essential 

&' * n developing a mutually beneficial exchange of information. 
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Purposes of Assessment ; 

1. To provide consultation and materials useful in 
assessing educational outcomes at all levels of 
responsibility. 

2. To determine, with the aid of local districts, 
the utility of assessment information in planning 
and evaluating educational endeavors. 
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Activities Completed : 



1. Meetings with key leaders in five largest 
districts regarding the substance and use of 
district results (19;'0-71). 

2. Reports and on-site consultation on procedures 
used in identifying goals, stating objectives 
and assessing needs.. 



APPENDIX B 



Methodology 

Statewide assessment of such broad and diverse goals and objectives was made 
possible by two fairly recent inventions - sampling and the electronic computer. 
Without these tools, the Assessment would be narrowly constrained, if not totally 
impossible. 

Sampling 

Certain systematic procedures in selection of students and selection of con- 
tent were observed to yield information indicative of student performances gen- 
erally in the state on all objectives. Sample design for 1971 was similar to 
that field-tested in 1970, as described in the report Assessing Educational 
Outcomes in Colorado (December 1970). Salient features of the sampling design 
are described briefly below. 

Selection of students . Samples of students were selected from the state 
population by three sequential steps: 

1* Selection o f districts : Stratified random sampling techniques we re 

used to select districts representative of all districts in Colo- 
rado. Specifically, all districts in Colorado were listed in order 
of size of pupil enrollment, the smallest first. Starting with the 
smallest, each sixth district was selected as a sample district. 

Of the state's 181 school districts, 30 districts were selected in 
this manner. School District No. 1 (Denver) was added independently 
of the sampling because of that district's unique size. A total of 
31 districts participated in the assessment as follows: 

SCHOOL DISTRICTS SAMPLED IN COLORADO'S I 97 I EDUCATIONAL ASSESSMENT 

Stratum 1 - Districts with enrollments over 1500 pupils 

Denver 1 
Jefferson R-l 
Adams 50 
Adams 14 
El Paso 2 
Adams 27J 
Otero R-l 
Douglas Rel 
Weld Re 8 
Gunnison Re-1 (J) 

Stratum M - Districts with enrollments between 1500-3000 

Huerfano Rel 
Clear Creek Rel 
Routt Re2 
Teller Re2 
Larimer Re3 
Baca Re4 
Dolores Rel 
Prowers Rel 
Grand 1 (J) 

Routt Rel 

Elbert Cl o* 



V 



STRATUM III - Districts with enrollments under 300 pupils 

Saguache Rel 
Alamosa Re22J 
Park 1 
Morgan Re20 
Logan Re5 
Las Animas 88 
Elbert C2 
Elbert 200 
Weld RelO 
Washington 101 

2. Selection of schools . Schools were selected at random from 
districts. Some districts, however, contained so few schools that all schools 
in the district were selected. 



j 3. Selection of classes . Each school principal was asked to alphabetize 

the names of the teachers of classes containing the grades of students being 
; assessed at the time given for the assessment at his school. Starting at the 

j top of the list, the principal would select classes until the required numbers 

\ of students were obtained. If a fraction of a class was needed, the teacher 

| would select the students randomly from an alphabetic class list. 

t 

j A major modification from the 1970 design was the increase in the numbers 

of students in the ten largest participating districts to yield information 
j useful within each of those districts. To counteract the over-representation of 

| large districts in the sample, a weighting formula was applied in the analysis 

j of data. (See next section on "Computer Analysis" in this Appendix). 

; Population and sample sizes are shown below according to three Strata: 

i 

i 

I 

j - TABLE 8 

- 

I POPULATION N's AND SAMPLE n«s IN 

COLORADO'S 1971 EDUCATIONAL ASSESSMENT 



£ 

f 



i 

r 

l 

f: 

i 



i 



f 



Stratum 



II 



Grade 



3 

N 


n 


6 

N 


n 


9 

N 


n 


12 

N n 


37,675 


596 


37,568 


596 


37,861 


520 


30,931 


580 


3,540 


103 


3,596 


112 


3,665 


109 


2,964 


110 


782 


27 


798 


32 


729 


37 


675 


28 




Selection of content . To sample student capabilities called for in the 
objectives (see Appendix A), objecti ves-referenced exercises were selected 
from, (a) those used in last year's Assessment, (b) those created by the California 
Test Bureau and the Laboratory of Educational Research at the University of 
Colorado, and (c) those available from the Instructional Objectives Exchange 
at the Uni vers i ty of California at Los Angeles. Numbers of exercises and 
objectives used is shown below: 



See page 86 following. 



Exercices were judged for congruence with objectives by staff members of 
the Colorado Department of Education using the form shown on page 99 
page. 



Field work. Proctors hired by the Department were trained to administer 
the assessment forms in the I 96 schools participating in the state sample. 
Their duties included reading instructions to students, answering questions, 
accounting for assessment materials and reporting irregularities. 

Analysis of Data 

•> 

A five-step process transformed the completed assessment instruments 
into data usable for this Needs Assessment. Central in all nine of these steps 
was the IBM 360 - Model 50 Computer of the Colorado Automated Data Processing 
Services, located in the Colorado State Capitol Building. 

1. Batching. Each of the completed assessment instruments was hand- 
checked for missing data and compliance with marking instructions 
before being put in school and district batches. Each school and 
district batch was then tied and marked with an identifying number. 

2. Keypunching and verifying . Student responses, both on the assess- 
ment exercises and on the biographical data sheets were transferred 
to data cards, 3 cards per instrument. Verification of keypunches 
was added for increased precision. 




Totals All Areas 



3. Fi 1 ing the data . The data from the cards were filed on magnetic 
tape for entry into the computer. An edit program located contr- 
dictory data which, after checking the source document, were cor- 
rected. A very low percentage of errors (less than .03%) made this 
task quite small . 

4. Unweighted analyses . The number and percentage of students making 
each response on each of the 28 instruments (7 content areas at each 
of 4 grade levels) was produced on the first computer run. For 
each exercise, there were 3 pages of computer printout, giving re- 
sults by population group, e.g., boys, girls, rural, urban, etc.. 

An example of this printout is included at the end of this appen- 
dix. Results were obtained for state totals, each of the ten 
largest school districts and the three strata making up the sample. 

5. Weighted analysis . Because the 10 larger districts were over- 

sampled to yield results for each of those districts, the sample 
was over-representative of larger districts and under-representative 
of smaller districts: therefore a weighting formula was applied 

to offset this imbalance as follows: 

(ft knowing answer) = pj Nj + p£Nj + p^N^ 

where p|, Pj , and p are the proportions of the sampled third- 
graders to answer a^particular item correctly in Strata 1, 2, 
and 3, respectively and N-, N , and N are the total number of 
students in the population of^Strata 3 , 2, and 3* respectively 
and nj, n , and n. are the sample sizes in Strata 1, 2, and 3. 
respectively. * 

Once the number knowing the answer was computed, it was a simple 
operation to find the percentage correct by: 

Percent correct » (^knowing answer) 



Weighted data were produced only for the state totals. 

6. State Analyses . For the entire state sample, percentages of 
students choosing each response option were listed by pupil 
population group (see sample printout). Both a weighted and 
unweighted analysis were run. 

7. District Analysis . For each of the ten largest districts par- 
ticipating, an unweighted analysis was made by population group. 



8. Strata Analysis . For each of the three strata an unweighted 
analysis was run. 



Sample printouts following show typical assessment results In both weighted 
and unweighted form. Following the printouts are samples of the "working 
papers" written by staff members of the Uni vers i ty of Colorado's Laboratory 
of Educational Research. 



TABLE 10 

CONTENT AREAS IN WHICH 
"WORKING PAPERS" HAVE BEEN COMPILED 



1970 



1971 



Health X X 

Language Arts X X 

Learner Self-concept X 

Mathematics X X 

Mus i c X X 

Physical Education X 
Science X 

Social Studies X 



OVERVIEW OF THE ASSESSMENT 

P rocess 

1 . I dent i f y i ng des i red outcomes 

1.1 Adopting long-range goals 

1.2 Adopting long-range objectives 

1.3 Judging year-end objectives 



Special consultants 
Special consultants 
Special proctors 

Professional staff and consultants 



2. Determining student performance 

2.1 Designing exercises 

2.2 Drawing a sample 

2.3 Administering exercises 

2.4 Analyzing results 

2.3 Determining students' performance 



State Board of Education 
State Board of Education 
Professional Staff 



3. Identifying learner needs 

3.1 Organizing reports Professional staff 

3.2 Interpreting reports Ad hoc panel on needs 



Reliability and Validity of the Instruments 

. Rei iabi 1 1 ity is that characteristic of a measur ing instrument which deals 
with consistency of results. Since the 1971 Needs Assessment Battery 
represented a criterion-referenced rather than a norm-referenced approach 
toward measurement, the Kuder-Richardson Formula #20 (coefficient of 
equivalence) was employed to assess the internal consistency of each subtest 
of the testing program. 

A 16% sub-sample of students participating in the 1971 Needs Assessment 
program served as the baseline data for reliability determination. The 
reliability coefficients contained in Tabled, were derived from the raw 
data described in Table 12. 



TABLE 11 

RELIABILITY ESTIMATES FOR 1971 NEEDS ASSESSMENT 



a »^Re liability 
16 Tests 




KR-20 Rel iabi li 


ity 


50- 


Item Rel iabi] 
Comparisons 


lity. 


Grade 

l 


Grade 

6 


Grade 

9 


Grade 

12 


Grade 

3 


Grade 

6 


Grade 

9 


Grade 

12 


Science 


.765 


.645 


.605 


.632 


.916 


.858 


.810 


.796 


Mathematics 


.693 


.624 


.667 


.818 


.869 


.822 


.840 


.915 


Language Arts 


.693. 


.427 


.660 


.573 


.825 


.662 


.795 


.713 


Health 


.616 


.544 


.463 


.586 


.817 


.758 


.545 


.771 


Learner Self Concept 


.648 


.850 


.360 


.273 


.860 


.940 


.652 


.631 


Music Affective 


.560 


.641 


.622 


.899 


.743 


.736 


.673 


.918 


Social Studies 




.487 


.505 


.665 


.723 


.693 


.797 


.825 


Estimated 


















Total Battery 


.927 


.920 


.922 


.936 


— 




— 






| The magnitude of a reliability coefficient varies directly with the 

t number of items contained in a subtest. From Table 12, it can be observed 

li; that the number of items in a subtest varies from a low of II items for Grade 

i- 12 Learner Self Concept to a high of 40 items for the Music Affective subtest 

1 Tor Grades 9 and 12. For direct comparison of rel iabi 1 ity coefficients, the 

l Spearman-Brown Prophesy Formula was applied to the KR-20 coefficient of each 

i subtest to determine a 50 item reliability. These data are contained in 

Tab I e 11. 

O 

i' 

• 1 ^ was hypothesized that subtests whose 50 -item reliability equaled or 

(■ exceeded .800 would be considered as reliable instruments. An analysis of the 

!; 50 item coefficients in Table II reveals the following: 

were reliable at the 



s 3 and 9 were reliable, 
1 2 were not. 

he Grade 3 level only. 

> rel iable at Grade 3 



h 
S ■ 
t, 

r, 

i. 



! ; 

& 

i v - 



I 



' £■■ 
p\ 



a) The Science and Mathematics subtests 
four grade levels. 

b) The Language Arts subtests for Grade 
while the sub tests for grades 6 and 

c) The Health subtest was reliable at t 

d) The Learner Self Concept subtest wa: 
and 6 level only. 
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e) The Music Affective subtest was reliable at the Grade 12 
level only. 

f) The Social Studies subtest was reliable at the Grade 9 and 
12 level only. 

With this information the reader may be cautioned against generalizations 
based on the entire subtests listed as unreliable above. However, such 
reservations need not apply to interpretations of results from individual 
exercises listed in Parts II and III of this report. (The conclusions stated 
in Part II were based on results from individual exercises, not complete subtests.) 
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The estimated total battery coefficient were determined by computation 
of an average rel iabi 1 i ty of the subtests for a given grade level, and applying 
the Spearman-Brown Prophesy formula. 

The raw data in Table 12 contain information on the number of items, 
sample size, mean, standard deviation, and standard error of measurement for 
each sub test in the reliability study. The standard error of measurement is 
a statistic which suggests a range within which an individual's true score 
would exist. For example, the Grade 6 subtest for the'learner self concept 
has a standard error of measurement of 1.5. One standard error of measurement 
on either side of an obtained score would suggest that two times out of three 
his true score would fall within that range; two standard errors of measurement 
would define the range wherein 95 times out of 100 his true score would fall. 

If a student had a raw score of 10, one could say that two times out of three 
his true score would fall in the 8.5 ” 11.5 range, and 95 times out of 100, 
his true score could fall in the 7-12 range. As a rule of thumb, the standard 
error of measurement on a good test rarely exceeds 50% of the magnitude of the 
standard deviation. .1 

Val idi tv is that quality of measurement which answers the question, 

"To what degree did the test measure what it was intended to measure and 
nothing else?" Criterion measurement instruments rely heavi ly upon content 
validity. Thus, the question becomes, "To what degree did the content of test 
items reflect the scope and relevant aspects of the educational objectives 
against which they were written?" For the 1971 Needs Assessment, individual 
items were revised or rejected on the basis of their relevance to subject- 
matter objectives agreed upon both by a wide sample of Colorado teachers and 
subject matter consultants of the Colorado Department of Education staff. It 
is not possible to determine the exact validity coefficient for the subtests 
on the 1971 Needs Assessment, except to say that from a content point of view 
it should be high. As an artifact of statistics, the validity coefficient 
cannot exceed the square root of the reliability coefficient. Employing this 
rule of thumb, the maximum validity would range from a low of .522 on the 
Grade 12 Learner Sel f .Concept subtest to a high of .9^8 in the Grade 12 Music 
Affective subtest. 
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APPENDIX C 

AN INVENTORY OF EDUCATIONAL OUTCOMES 
DESIRED IN COLORADO 
(Partial) 



Since I 969 , the Colorado Department of Education has been collecting, 
revising, cataloguing and sharing educational objectives. Judgments of 
educators/teachers and curriculum experts as to appropriateness and importance 
of many of the objectives were sampled in late I 969 . Objectives upon which 
the 1970 statewide assessment was based were refined for increased relevance 
and precision. 

Following are listed instructional objectives in capsule form to 
indicate some of the educational outcomes commonly desired in Colorado, 

A. LEARNING SKILLS 

Language Arts - Grades 3 and 6 
Using contextual clues 
Distinguishing fact from opinion 
Using information sources 
Selecting correct usage 

Language Arts - Grades 9 and 12 

Distinguishing between correct and incorrect usage 
Analyzing English composition 

Mathematics - Grades 3 and 6 

Adding, subtracting, multiplying, and dividing 

Identifying standard measures 

Computing time, rate, and distance 

Finding information from a statistical table 

Computing prices, making change 

Applying concepts of positive and negative numbers 

Mathematics - Grades 9 and 12 
Solving common problems 
Identifying number relationships 
Identifying structural properties 
Computation with fractions and decimals 
Identifying true and faulty logic 
Computing probability 

Science - Grades 3 and 6 

Demonstrating scientific curiosity 
Explaining natural events 

Science Grades 9 and 12 

Identifying processes and procedures 
Explaining natural phenomena 



B. LEARNER SELF-CONCEPT 



Describing seif as capable 



Predicting academic success 



Identifying with capable learners 
Predicting non-academic success 



C. SOCIAL KNOWLEDGES AND SKILLS 



Map Reading 



! 



Demonstrating Knowledge of Social Organization 
Reasons for laws 
Organization of government 
Legal processes 



Identifying Appropriate Social Processes 
Demonstrating Historical Perspective 

D. HEALTH INFORMATION 
Grade Three 

Identifying healthful eating habits 
Recognizing physically beneficial practices 
Recognizing harmful effects of smoking 
Identifying practices of dental care 
Recognizing correct uses of drugs 

Grade Six 

Identifying healthful eating habits 
Recognizing physically beneficial practices 
Demonstrating knowledge of disease and mental illness 
Recognizing dangers of smoking and drugs 

Grade Nine 

Identifying healthful eating habits 

Demonstrating knowledge of physical fitness, growth, and development 
Recognizing dangers of drugs 

Grade Twelve 

Nutrition and weight control 

Demonstrating knowledge of physical growth and development 
Disease prevention 
Knowledge of mental illness 
Drug information 
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E. APPRECIATING MUSIC 

Valuing Music as Self Expression 
Liking Music of Various Types 
Valuing Music For Itself 

F. KNOWLEDGE OF OCCUPATIONS 

Recognizing Education Needed 
Work Involved 

Identifying Occupations Related 

Identifying Corresponding Field of Work 

Development of Year-End Objectives 

Others wishing to develop objectives specifying what performance 
capabilities students should acquire may be interested in the process used 
in Colorado. 

Writing objectives . Consultants, representing several subject 
disciplines, met in a week-long work conference to write objectives. Used 
as the basis of these objectives was Goals for Education in Colorado, a 
document authorized by the Colorado State Board of Education in 1962. For 
example, from the general goal of 

"Adequate opportunities for all persons to acquire command 
of knowledge, skills, habits, and attitudes essential for 
effective learning throughout life . . ." 

was derived this more specific objective: 

"The pupil will apply his ability to use pa'rts of a book 
with facility as measured by an exercise directing the 
pupil to locate and use the fol lowing parts: (a) Title 

page, (b) Table of Contents, (c) Glossary, and (d) List of 
Illustrations." 

(Third Grade Language Arts; objective No. 24.) 

Specifications for objectives provided that each contain these elements: 

(1) the subject toward which attention was to be directed, i.e., "the pupil," 

(2) the behavior sought, i.e, "will apply his ability u> use," (3) the content 
i.e., "parts of a book," and (4) a measuring device, i.e. "an exercise..." 

Defining cont ent areas . The objectives stated in the various subject 
disciplines were put in broader context by construction of a three-dimensional 
model (see page 100). The objectives* were represented on one dimension of 

the model - that dimension identifying common program offerings in Colorado 
schools. 



A second dimension of the model identified basic educational outcomes 
derived from Goals for Education in Colorado . In this way, general and specifi 
aspects of the content to be assessed were related visually. 

A third dimension of the model identified behaviors sought. These 
behaviors were classified according to the cognitive, affective, and psycho- 
motor domains as developed by Bloom and others. 

Thus, content areas were defined in a way which suggested possibilities 
(1) for item development, and (2) for constructing hypotheses on educational 
need. With definition of these content areas, it was proposed that sampling 
procedures be employed to select pupils and to select items to assess learning 
in the content areas so defined. 

Ju dging objectives . Task Force members inspected the objectives for con- 
sistency with specifications and then submitted lists of objectives to a sample 
of teachers in Colorado for judgment. Objectives which were acceptable to 
teachers were used; those unacceptable to teachers were discarded. 

For example, the Objective for Third Grade Language Arts stated above 
was deemed "very important" by 41.4% of the teachers ampled, "important" by 
47.1% of the teachers sampled, "unimportant" by 6.9% and "very unimportant" 
by 1.1% of the teachers (3.5% not responding). Finding that 88.5% of the 
teachers sampled deemed this objective "important" or "very important," the 
Task Force judged the objective to be acceptable as a basis for assessment 
and evaluation of learning in Colorado. The form for exercise judgment is 
as follows: 



Judge 



Item # 
Pool 



ITEM JUDGEMENT 



Good 



Face Va I i di ty - "Does the item measure what it 

appears to measure?" 1 2 

1. Can be related to instructional activities 

commonly found in schools. 1 2 

2. Interesting to lay persons and professional 

educators. | 2 

3- Appropriate to age of assessee, clear, un- 
ambiguous, not a trick question. 1 2 



Content Validity - 'To what extent does this item 

require demonstration by the stu- 
dent of the achievement which con- 
stitutes the objective of instruc- 
tion in this area?" 1 2 

1. Elicits a skill, attitude or knowledge necessary 

to perform the task specified in the objective. I 2 

2. Relates, logically or empirically, to other items 

assessing achievement of the same objective 1 2 



Comments: 



Bad 
4 5 

4 5 

4 5 

4 5 

4 5 

4 5 

4 5 
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OVERVIEW OF VARIABLES 



Basic. Educational Outcomes 

1. Knowledge of Science info, skills, concepts. 

2. Knowledge of Mathematics info, skills, concepts. 

3. Knowledge of Social Studies info, skills, concepts. 

4. Ability to read rapidly with comprehension. 

5. Ability to communicate in Writing. 

6. Ability to Spell correctly. 

7. Knowledge and appreciation of Music. 

8. Ability to draw and to appreciate Art. 

9. Knowledge of Health skills and concepts. 

10. Physical proficiency. (S already being measured) 

11. Proficiency in and knowledge of Home Economics. 

12. Proficiency in and knowledge of one or more Industrial Arts. 

13. Cognizance of Occupational Opportunities. 

14. Interest in School, School Subjects, and Education. 

15. Value of Self, Family, Society. 

16. Ability and initiative to solve real and pressing problems. 

17. Ability and desire to participate in group work. 



1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 



Program 

Curricular: 

a. Science 

b. Math 




a c. Social Studies 



b d. Reading 



c. Eng. Comp., Grammar, Lit. 

f. Spelling 

g. Music 

h. Art 

i. Health, Safety, Recreation 

j. Physical Education 

k. Home Economics 

l. Voc. Ed/ Industrial Arts 



j m. Foreign Languages 



1 Co -curricular: 



m n. Guidance 



n o. Health 



Student 

Behavior 







o p. Psychological 



q. Social 

r. Library 
6. Food 

t. Transportation 



A. Cognitive 

B. Affective 



Student and family information: 

Age /Sex /Race or Ethnic Origin/Enrollcd in this 
school 3 years ago/Sccond language when in home/ 
I. Q. /Occupation of head of household /Education. 



In the Context of — 



C. Psychomotor 



of mother. 



